[ 563.049697] env[69343]: INFO neutron.common.config [-] Logging enabled! [ 563.050025] env[69343]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev14 [ 563.050179] env[69343]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69343) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 563.050483] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 563.050591] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 563.051440] env[69343]: WARNING oslo_policy.policy [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 563.051673] env[69343]: WARNING oslo_policy.policy [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 563.053213] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] VMware NSXv3 Agent initialized successfully. [ 563.053576] env[69343]: DEBUG oslo_concurrency.lockutils [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] Acquiring lock "singleton_lock" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.053755] env[69343]: DEBUG oslo_concurrency.lockutils [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] Acquired lock "singleton_lock" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.053921] env[69343]: DEBUG oslo_concurrency.lockutils [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] Releasing lock "singleton_lock" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.054261] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] Full set of CONF: {{(pid=69343) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 563.054440] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ******************************************************************************** {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 563.054560] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] Configuration options gathered from: {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 563.054816] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 563.054988] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 563.055114] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ================================================================================ {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 563.055295] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] agent_down_time = 75 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.055441] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] allow_automatic_dhcp_failover = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.055583] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] allow_bulk = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.055731] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] api_extensions_path = {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.055881] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] api_paste_config = api-paste.ini {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.056038] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] auth_strategy = keystone {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.056151] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] backdoor_port = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.056259] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] backdoor_socket = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.056402] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] backlog = 4096 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.056548] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] base_mac = fa:16:3e:00:00:00 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.056875] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] bind_host = 0.0.0.0 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.057074] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] bind_port = 9696 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.057307] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] client_socket_timeout = 900 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.057453] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] config_dir = [] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.057567] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.057916] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] config_source = [] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.057916] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] control_exchange = neutron {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.058033] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] core_plugin = ml2 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.058152] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] debug = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.058298] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] default_availability_zones = [] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.058515] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.058664] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] dhcp_agent_notification = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.058806] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] dhcp_agents_per_network = 1 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.058945] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] dhcp_lease_duration = 86400 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.059110] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] dhcp_load_type = networks {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.059255] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] dns_domain = openstacklocal {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.059404] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.059546] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] enable_default_route_bfd = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.059672] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] enable_default_route_ecmp = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.059810] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] enable_dvr = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.059952] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] enable_new_agents = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.060102] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.060241] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] enable_signals = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.060385] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] enable_traditional_dhcp = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.060511] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] external_dns_driver = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.060646] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] filter_validation = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.060795] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] global_physnet_mtu = 8950 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.060935] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] graceful_shutdown_timeout = 60 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.061185] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] host = cpu-1 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.061297] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] host_dvr_for_dhcp = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.061444] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] http_retries = 3 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.061594] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] instance_format = [instance: %(uuid)s] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.061738] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.061881] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ipam_driver = internal {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.062030] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ipv6_pd_enabled = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.062175] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] l3_ha = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.062320] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.062463] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] l3_ha_network_physical_name = {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.062605] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] l3_ha_network_type = {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.062748] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] log_color = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.062890] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] log_config_append = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.063041] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.063183] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] log_dir = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.063320] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] log_file = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.063432] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] log_options = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.063576] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] log_rotate_interval = 1 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.063723] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] log_rotate_interval_type = days {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.063866] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] log_rotation_type = none {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.063974] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.064092] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.064325] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.064380] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.064508] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.064622] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] max_dns_nameservers = 5 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.064766] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] max_header_line = 16384 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.064906] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] max_l3_agents_per_router = 3 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.065055] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] max_logfile_count = 30 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.065195] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] max_logfile_size_mb = 200 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.065338] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] max_subnet_host_routes = 20 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.065486] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] my_ip = 10.180.1.21 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.065629] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] my_ipv6 = ::1 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.065769] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] network_auto_schedule = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.065903] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] network_link_prefix = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.066061] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.066208] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] notify_nova_on_port_data_changes = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.066353] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] notify_nova_on_port_status_changes = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.066496] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] pagination_max_limit = -1 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.066633] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] publish_errors = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.066770] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] rate_limit_burst = 0 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.066914] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] rate_limit_except_level = CRITICAL {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.067064] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] rate_limit_interval = 0 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.067204] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] retry_until_window = 30 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.067421] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] router_distributed = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.067478] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] rpc_resources_processing_step = 20 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.067617] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] rpc_response_max_timeout = 600 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.067760] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] rpc_response_timeout = 60 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.067898] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] send_events_interval = 2 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.068066] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] service_plugins = ['router'] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.068215] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] setproctitle = on {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.068362] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] shell_completion = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.068499] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] state_path = /opt/stack/data/neutron {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.068642] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] syslog_log_facility = LOG_USER {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.068783] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] tcp_keepidle = 600 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.068927] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] transport_url = **** {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.069073] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] use_journal = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.069212] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] use_json = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.069351] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] use_ssl = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.069486] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] use_stderr = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.069628] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] use_syslog = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.069764] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] vlan_qinq = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.069899] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] vlan_transparent = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.070044] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] watch_log_file = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.070185] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] wsgi_default_pool_size = 100 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.070321] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] wsgi_keep_alive = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.070470] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.070607] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] wsgi_server_debug = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 563.070762] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_concurrency.disable_process_locking = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.070913] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.071075] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.071219] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.071364] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.071511] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.071652] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.071808] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] profiler.connection_string = messaging:// {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.071955] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] profiler.enabled = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.072115] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] profiler.es_doc_type = notification {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.072261] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] profiler.es_scroll_size = 10000 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.072407] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] profiler.es_scroll_time = 2m {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.072553] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] profiler.filter_error_trace = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.072704] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] profiler.hmac_keys = **** {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.072851] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] profiler.sentinel_service_name = mymaster {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.073033] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] profiler.socket_timeout = 0.1 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.073163] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] profiler.trace_requests = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.073308] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] profiler.trace_sqlalchemy = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.073469] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] profiler_jaeger.process_tags = {} {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.073613] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] profiler_jaeger.service_name_prefix = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.073756] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] profiler_otlp.service_name_prefix = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.073931] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_policy.enforce_new_defaults = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.074208] env[69343]: WARNING oslo_config.cfg [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 563.074452] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_policy.enforce_scope = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.074521] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_policy.policy_default_rule = default {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.074685] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.074836] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.074986] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.075138] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.075280] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.075416] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.075556] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.075702] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_policy.remote_timeout = 60.0 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.075856] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.076018] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] agent.extensions = [] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.076167] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.076317] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] service_providers.service_provider = [] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.076473] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] QUOTAS.default_quota = -1 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.076626] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.076769] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] QUOTAS.quota_floatingip = 50 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.076912] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] QUOTAS.quota_network = 100 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.077064] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] QUOTAS.quota_port = 500 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.077205] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.077351] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] QUOTAS.quota_router = 10 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.077584] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] QUOTAS.quota_security_group = 10 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.077635] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.077766] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] QUOTAS.quota_subnet = 100 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.077905] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] QUOTAS.track_quota_usage = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.078070] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.078210] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep.group = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.078350] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep.helper_command = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.078506] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.078655] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep.thread_pool_size = 8 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.078793] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep.user = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.078942] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.079090] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_dhcp_release.group = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.079228] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_dhcp_release.helper_command = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.079369] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.079512] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.079651] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_dhcp_release.user = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.079795] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.079933] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_ovs_vsctl.group = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.080078] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_ovs_vsctl.helper_command = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.080222] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.080362] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.080501] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_ovs_vsctl.user = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.080647] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_namespace.capabilities = [21] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.080781] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_namespace.group = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.080919] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_namespace.helper_command = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.081072] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.081218] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_namespace.thread_pool_size = 8 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.081357] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_namespace.user = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.081507] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_conntrack.capabilities = [12] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.081643] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_conntrack.group = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.081780] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_conntrack.helper_command = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.081922] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.082076] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.082213] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_conntrack.user = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.082362] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_link.capabilities = [12, 21] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.082501] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_link.group = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.082635] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_link.helper_command = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.082773] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.082916] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_link.thread_pool_size = 8 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.083060] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] privsep_link.user = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.083224] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.083376] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.083522] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.continue_on_failed_promotions = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.083665] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.dscp = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.083805] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.dscp_inherit = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.083951] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.force_mp_to_policy = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.084101] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.locking_coordinator_url = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.084242] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.log_agent_heartbeats = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.084385] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.logging_expire = 1 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.084587] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.084679] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.084823] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.polling_interval = 240 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.084966] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.085125] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.085274] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.report_interval = 30.0 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.085423] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.085570] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.085716] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.085863] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.sync_skew = 60 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.086012] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.synchronization_queue_size = 20 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.086161] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT.use_helper_for_ns_read = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.086311] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] SECURITYGROUP.enable_ipset = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.086461] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] SECURITYGROUP.enable_security_group = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.086608] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.086754] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.086902] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] experimental.ipv6_pd_enabled = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.087076] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ml2.extension_drivers = ['port_security'] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.087218] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ml2.external_network_type = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.087385] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.087529] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ml2.overlay_ip_version = 4 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.087748] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ml2.path_mtu = 8950 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.087823] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ml2.physical_network_mtus = {} {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.087974] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ml2.tenant_network_types = ['vlan'] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.088132] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.088287] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ml2.type_drivers = ['vlan'] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.088437] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT_CLI.neutron_port_id = [] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.088708] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.088708] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.088871] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.089027] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.089178] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.089325] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.089475] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.089623] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.089836] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.089991] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_login_password = **** {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.090161] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_login_port = 443 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.090311] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_login_user = admin {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.090463] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.090611] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.090757] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.090901] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.091061] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.091214] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.091362] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.091512] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.091656] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.091802] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.091985] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.092113] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.092257] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.092461] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.092614] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] vsphere.vsphere_login_password = VMware1! {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.092763] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.092906] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.093065] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] nova.auth_section = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.093221] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] nova.auth_type = password {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.093368] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.093508] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] nova.certfile = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.093651] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] nova.collect_timing = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.093802] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] nova.endpoint_type = public {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.093944] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] nova.insecure = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.094091] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] nova.keyfile = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.094240] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] nova.region_name = RegionOne {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.094385] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] nova.split_loggers = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.094527] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] nova.timeout = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.094729] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] placement.auth_section = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.094819] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] placement.auth_type = password {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.094968] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.095114] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] placement.certfile = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.095304] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] placement.collect_timing = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.095406] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] placement.endpoint_type = public {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.095584] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] placement.insecure = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.095722] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] placement.keyfile = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.095856] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] placement.region_name = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.095997] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] placement.split_loggers = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.096144] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] placement.timeout = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.096292] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.auth_section = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.096433] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.auth_type = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.096570] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.cafile = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.096706] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.certfile = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.096846] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.collect_timing = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.096985] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.connect_retries = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.097137] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.connect_retry_delay = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.097304] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.enable_notifications = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.097418] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.endpoint_override = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.097560] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.insecure = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.097700] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.interface = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.097912] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.keyfile = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.097961] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.max_version = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.098110] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.min_version = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.098247] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.region_name = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.098386] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.retriable_status_codes = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.098522] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.service_name = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.098658] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.service_type = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.098801] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.split_loggers = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.098940] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.status_code_retries = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.099095] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.status_code_retry_delay = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.099235] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.timeout = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.099372] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.valid_interfaces = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.099510] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ironic.version = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.099656] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] cli_script.dry_run = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.099806] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.099947] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.100101] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.100245] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.100384] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.100526] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.100666] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.100822] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.100965] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.101127] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.101266] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.101412] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.101559] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.101704] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.101846] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.101988] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.102143] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.102286] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.102434] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.102576] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.102721] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.102868] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.103026] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.103164] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.103306] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.103447] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.103598] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.103735] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.103874] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.104025] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.104170] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.ssl = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.104319] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.104463] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.104604] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.104749] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.104887] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.ssl_version = {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.105094] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.105189] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_notifications.driver = [] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.105333] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_notifications.retry = -1 {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.105490] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.105632] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] oslo_messaging_notifications.transport_url = **** {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 563.105745] env[69343]: DEBUG oslo_service.backend.eventlet.service [None req-f0f9e117-f713-4f0f-8aa2-ea9fa7ef0877 None None] ******************************************************************************** {{(pid=69343) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 563.106820] env[69343]: DEBUG neutron.agent.securitygroups_rpc [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Init firewall settings (driver=nsxv3) {{(pid=69343) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 563.108170] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69343) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 563.108426] env[69343]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] RPC agent_id: nsxm-l-01a.corp.local [ 563.110740] env[69343]: DEBUG dogpile.cache.region [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 563.110863] env[69343]: DEBUG dogpile.lock [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 563.110962] env[69343]: DEBUG dogpile.lock [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 563.111070] env[69343]: DEBUG dogpile.lock [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 563.111169] env[69343]: DEBUG dogpile.cache.region [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 563.111259] env[69343]: DEBUG dogpile.lock [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 563.111386] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 563.144421] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Session token - acquiring [ 563.146106] env[69343]: DEBUG networking_nsxv3.common.locking [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.146291] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.146393] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.146873] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.157975] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.440354] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 563.461880] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 563.462063] env[69343]: DEBUG dogpile.cache.region [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Cache value generated in 0.351 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 563.462140] env[69343]: DEBUG dogpile.lock [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 563.462274] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Activating Policy API Provider. [ 563.462484] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Looking for the default Infrastructure Rules. [ 563.528426] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Looking for the Default Layer3 Logged Drop Section. [ 563.545889] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 563.546389] env[69343]: DEBUG networking_nsxv3.common.locking [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.546567] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquiring lock "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.546676] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired lock "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.547051] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired external semaphore "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.547427] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.062117] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.564325] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.066614] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Inventory metadata is going to be refreshed. [ 565.067024] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 565.876929] env[69343]: DEBUG networking_nsxv3.common.locking [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.877356] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.877356] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.877743] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.889856] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 565.998979] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.000055] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 566.022832] env[69343]: DEBUG networking_nsxv3.common.locking [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.023123] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.023123] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.023393] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.023527] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.023682] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 566.023802] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 566.023910] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 566.044114] env[69343]: DEBUG networking_nsxv3.common.locking [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.044409] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.044409] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.044691] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.044868] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.045028] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 566.065741] env[69343]: DEBUG networking_nsxv3.common.locking [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.066061] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.066061] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.066339] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.066493] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.066644] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 566.088800] env[69343]: DEBUG networking_nsxv3.common.locking [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.089083] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquiring lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.089083] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.089392] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired external semaphore "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.089541] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Releasing lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.089720] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 566.089840] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 566.089952] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 566.109228] env[69343]: DEBUG networking_nsxv3.common.locking [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.109484] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquiring lock "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.109555] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired lock "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.109860] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired external semaphore "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.109997] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Releasing lock "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.110162] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 566.110269] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 566.110378] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 566.131406] env[69343]: DEBUG networking_nsxv3.common.locking [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.131687] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.131687] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.131998] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.132191] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.132366] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 566.132479] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 566.132599] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Inventory metadata have been refreshed. [ 566.132706] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Dryrun:True. Metadata refresh completed. [ 566.132829] env[69343]: DEBUG oslo_concurrency.lockutils [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Releasing lock "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.134551] env[69343]: INFO neutron.agent.agent_extensions_manager [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Loaded agent extensions: [] [ 566.135389] env[69343]: DEBUG neutron_lib.callbacks.manager [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69343) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 566.195365] env[69343]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] NSXv3 Agent Agent RPC Daemon Started! [ 566.195574] env[69343]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] NSXv3 Agent Agent loop - iteration:0 started [ 566.195574] env[69343]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] NSXv3 Agent Agent out of sync with plugin! [ 571.135863] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 571.135863] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 576.137260] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 576.137260] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 580.386758] env[69343]: INFO networking_nsxv3.common.synchronization [None req-cfd7525e-877c-4ffa-b8a2-f7dacd97880a demo admin] Enqueued Resource ID: d3e6422e-2901-48c7-8d07-ca3a90edcbc7 with Priority: HIGHEST for action security_group_rules [ 580.387496] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3e6422e-2901-48c7-8d07-ca3a90edcbc7 with Priority: HIGHEST for action security_group_rules [ 580.387926] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3e6422e-2901-48c7-8d07-ca3a90edcbc7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.388207] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3e6422e-2901-48c7-8d07-ca3a90edcbc7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.388296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3e6422e-2901-48c7-8d07-ca3a90edcbc7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.388724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3e6422e-2901-48c7-8d07-ca3a90edcbc7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.388814] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3e6422e-2901-48c7-8d07-ca3a90edcbc7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.908947] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.909164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.909164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.909321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.909413] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.909509] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3e6422e-2901-48c7-8d07-ca3a90edcbc7 already deleted. [ 580.909591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3e6422e-2901-48c7-8d07-ca3a90edcbc7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.388974] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 585.389444] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 590.390278] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 590.390467] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 595.392023] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 595.392023] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 600.393253] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 600.393811] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 605.394395] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 605.394738] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 610.395571] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 610.395571] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 611.998286] env[69343]: INFO networking_nsxv3.common.synchronization [None req-71845796-56a5-4e5b-85e7-f5e8677a4d34 None None] Enqueued Resource ID: fc7547a1-d554-4d9e-a738-c2a9f596a067 with Priority: HIGHEST for action port [ 611.998915] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc7547a1-d554-4d9e-a738-c2a9f596a067 with Priority: HIGHEST for action port [ 611.999760] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc7547a1-d554-4d9e-a738-c2a9f596a067 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.000566] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc7547a1-d554-4d9e-a738-c2a9f596a067" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.000811] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc7547a1-d554-4d9e-a738-c2a9f596a067" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.001451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc7547a1-d554-4d9e-a738-c2a9f596a067" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.001580] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc7547a1-d554-4d9e-a738-c2a9f596a067',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.505244] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc7547a1-d554-4d9e-a738-c2a9f596a067 [ 612.505353] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.505442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.505477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.505668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.505756] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.505848] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc7547a1-d554-4d9e-a738-c2a9f596a067 already deleted. [ 612.505923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc7547a1-d554-4d9e-a738-c2a9f596a067" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.481026] env[69343]: INFO networking_nsxv3.common.synchronization [None req-e3e63bea-6f10-4c92-a287-aca2fac1c62e None None] Enqueued Resource ID: 221f8f7c-5853-49b9-81f9-418299519a27 with Priority: HIGHEST for action port [ 613.481842] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 221f8f7c-5853-49b9-81f9-418299519a27 with Priority: HIGHEST for action port [ 613.481916] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-221f8f7c-5853-49b9-81f9-418299519a27 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.482034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-221f8f7c-5853-49b9-81f9-418299519a27" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.482101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-221f8f7c-5853-49b9-81f9-418299519a27" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.482357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-221f8f7c-5853-49b9-81f9-418299519a27" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.482457] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('221f8f7c-5853-49b9-81f9-418299519a27',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.789074] env[69343]: INFO networking_nsxv3.common.synchronization [None req-169359ad-ed35-406c-9bcd-0cc8da21911e None None] Enqueued Resource ID: abd12d37-900a-4c8d-b5b3-073505e1d765 with Priority: HIGHEST for action port [ 613.789390] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd12d37-900a-4c8d-b5b3-073505e1d765 with Priority: HIGHEST for action port [ 613.789877] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-abd12d37-900a-4c8d-b5b3-073505e1d765 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.789877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abd12d37-900a-4c8d-b5b3-073505e1d765" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.790085] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abd12d37-900a-4c8d-b5b3-073505e1d765" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.790221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abd12d37-900a-4c8d-b5b3-073505e1d765" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.790348] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abd12d37-900a-4c8d-b5b3-073505e1d765',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.984999] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 221f8f7c-5853-49b9-81f9-418299519a27 [ 613.985269] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.985403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.985471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.985689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.985780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.985877] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:221f8f7c-5853-49b9-81f9-418299519a27 already deleted. [ 613.985961] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-221f8f7c-5853-49b9-81f9-418299519a27" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.294673] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abd12d37-900a-4c8d-b5b3-073505e1d765 [ 614.294673] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.294673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.294673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.294673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.294673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.294673] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abd12d37-900a-4c8d-b5b3-073505e1d765 already deleted. [ 614.294673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abd12d37-900a-4c8d-b5b3-073505e1d765" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.139760] env[69343]: INFO networking_nsxv3.common.synchronization [None req-ca72df6c-4740-45e8-b7f1-a9f2ce1594da None None] Enqueued Resource ID: 41a20b60-3c2d-491b-9c98-48427532ee49 with Priority: HIGHEST for action port [ 615.139985] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41a20b60-3c2d-491b-9c98-48427532ee49 with Priority: HIGHEST for action port [ 615.140490] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-41a20b60-3c2d-491b-9c98-48427532ee49 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.140628] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41a20b60-3c2d-491b-9c98-48427532ee49" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.140707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41a20b60-3c2d-491b-9c98-48427532ee49" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.141062] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41a20b60-3c2d-491b-9c98-48427532ee49" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.142224] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41a20b60-3c2d-491b-9c98-48427532ee49',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.282112] env[69343]: INFO networking_nsxv3.common.synchronization [None req-d4a69ed8-60c1-45cc-aedc-e9e78f0574b8 None None] Enqueued Resource ID: 369a044b-12af-49bc-a2e5-cc4df356c8cd with Priority: HIGHEST for action port [ 615.282670] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 369a044b-12af-49bc-a2e5-cc4df356c8cd with Priority: HIGHEST for action port [ 615.282972] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-369a044b-12af-49bc-a2e5-cc4df356c8cd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.284769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-369a044b-12af-49bc-a2e5-cc4df356c8cd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.284769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-369a044b-12af-49bc-a2e5-cc4df356c8cd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.284769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-369a044b-12af-49bc-a2e5-cc4df356c8cd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.285703] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('369a044b-12af-49bc-a2e5-cc4df356c8cd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.645267] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41a20b60-3c2d-491b-9c98-48427532ee49 [ 615.645522] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.646453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.646749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.646995] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.647103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.647205] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41a20b60-3c2d-491b-9c98-48427532ee49 already deleted. [ 615.647285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41a20b60-3c2d-491b-9c98-48427532ee49" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.788889] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 369a044b-12af-49bc-a2e5-cc4df356c8cd [ 615.788889] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.788889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.788889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.788889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.788889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.788889] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:369a044b-12af-49bc-a2e5-cc4df356c8cd already deleted. [ 615.788889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-369a044b-12af-49bc-a2e5-cc4df356c8cd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.013575] env[69343]: INFO networking_nsxv3.common.synchronization [None req-d103de39-59fa-4652-ac49-3e68f472d1fc None None] Enqueued Resource ID: a36f608d-ad90-442a-a146-f6ec149e0ac7 with Priority: HIGHEST for action port [ 616.014799] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a36f608d-ad90-442a-a146-f6ec149e0ac7 with Priority: HIGHEST for action port [ 616.016031] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-a36f608d-ad90-442a-a146-f6ec149e0ac7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.016031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a36f608d-ad90-442a-a146-f6ec149e0ac7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.016380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a36f608d-ad90-442a-a146-f6ec149e0ac7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.017048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a36f608d-ad90-442a-a146-f6ec149e0ac7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.017048] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a36f608d-ad90-442a-a146-f6ec149e0ac7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.425249] env[69343]: INFO networking_nsxv3.common.synchronization [None req-ec39f165-d63f-450b-96e2-cc59b8eb462a None None] Enqueued Resource ID: 79f4e943-f063-47ee-b6fd-318e96712f21 with Priority: HIGHEST for action port [ 616.425249] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79f4e943-f063-47ee-b6fd-318e96712f21 with Priority: HIGHEST for action port [ 616.425874] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-79f4e943-f063-47ee-b6fd-318e96712f21 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.425967] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79f4e943-f063-47ee-b6fd-318e96712f21" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.425967] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79f4e943-f063-47ee-b6fd-318e96712f21" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.426367] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79f4e943-f063-47ee-b6fd-318e96712f21" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.426450] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79f4e943-f063-47ee-b6fd-318e96712f21',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.520557] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a36f608d-ad90-442a-a146-f6ec149e0ac7 [ 616.523516] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.523516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.523516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.523516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.523766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.523945] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a36f608d-ad90-442a-a146-f6ec149e0ac7 already deleted. [ 616.524118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a36f608d-ad90-442a-a146-f6ec149e0ac7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.576205] env[69343]: INFO networking_nsxv3.common.synchronization [None req-c5592d8e-ed35-4f9e-913e-4d6d68d5da6d None None] Enqueued Resource ID: 7f9ff195-9ab7-454b-a0ac-76d32fb2528b with Priority: HIGHEST for action port [ 616.576581] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f9ff195-9ab7-454b-a0ac-76d32fb2528b with Priority: HIGHEST for action port [ 616.577161] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f9ff195-9ab7-454b-a0ac-76d32fb2528b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.577672] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f9ff195-9ab7-454b-a0ac-76d32fb2528b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.577672] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f9ff195-9ab7-454b-a0ac-76d32fb2528b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.577672] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f9ff195-9ab7-454b-a0ac-76d32fb2528b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.577672] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f9ff195-9ab7-454b-a0ac-76d32fb2528b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.931811] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79f4e943-f063-47ee-b6fd-318e96712f21 [ 616.935389] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.935824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.935824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.935824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.936596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.936596] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79f4e943-f063-47ee-b6fd-318e96712f21 already deleted. [ 616.936596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79f4e943-f063-47ee-b6fd-318e96712f21" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.081299] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f9ff195-9ab7-454b-a0ac-76d32fb2528b [ 617.081299] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.081299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.081299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.081299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.081299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.081299] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f9ff195-9ab7-454b-a0ac-76d32fb2528b already deleted. [ 617.081299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f9ff195-9ab7-454b-a0ac-76d32fb2528b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.661433] env[69343]: INFO networking_nsxv3.common.synchronization [None req-03b1f192-10c6-40bc-8996-856cc7efc1a1 None None] Enqueued Resource ID: 89cca4ca-3287-4d1b-96b9-a6b1e496639b with Priority: HIGHEST for action port [ 617.661699] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89cca4ca-3287-4d1b-96b9-a6b1e496639b with Priority: HIGHEST for action port [ 617.662377] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-89cca4ca-3287-4d1b-96b9-a6b1e496639b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.662504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89cca4ca-3287-4d1b-96b9-a6b1e496639b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.662594] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89cca4ca-3287-4d1b-96b9-a6b1e496639b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.665215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89cca4ca-3287-4d1b-96b9-a6b1e496639b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.665310] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89cca4ca-3287-4d1b-96b9-a6b1e496639b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.167493] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89cca4ca-3287-4d1b-96b9-a6b1e496639b [ 618.167791] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.167978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.168060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.168275] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.168380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.168491] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89cca4ca-3287-4d1b-96b9-a6b1e496639b already deleted. [ 618.168607] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89cca4ca-3287-4d1b-96b9-a6b1e496639b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.416657] env[69343]: INFO networking_nsxv3.common.synchronization [None req-3a36567f-0c8e-4d6a-a58e-3785a0b585e0 None None] Enqueued Resource ID: 63594bfe-1612-4b3d-a1ab-8185da42cb64 with Priority: HIGHEST for action port [ 618.416919] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63594bfe-1612-4b3d-a1ab-8185da42cb64 with Priority: HIGHEST for action port [ 618.418200] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-63594bfe-1612-4b3d-a1ab-8185da42cb64 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.418200] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63594bfe-1612-4b3d-a1ab-8185da42cb64" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.418200] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63594bfe-1612-4b3d-a1ab-8185da42cb64" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.418200] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63594bfe-1612-4b3d-a1ab-8185da42cb64" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.418200] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63594bfe-1612-4b3d-a1ab-8185da42cb64',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.650847] env[69343]: INFO networking_nsxv3.common.synchronization [None req-81951ba0-47d3-4851-b729-2161b4594004 None None] Enqueued Resource ID: 3e03db3b-6528-481b-9c2c-d46eb69f6695 with Priority: HIGHEST for action port [ 618.650847] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e03db3b-6528-481b-9c2c-d46eb69f6695 with Priority: HIGHEST for action port [ 618.650847] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e03db3b-6528-481b-9c2c-d46eb69f6695 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.650847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e03db3b-6528-481b-9c2c-d46eb69f6695" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.650847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e03db3b-6528-481b-9c2c-d46eb69f6695" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.650847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e03db3b-6528-481b-9c2c-d46eb69f6695" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.650847] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e03db3b-6528-481b-9c2c-d46eb69f6695',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.923088] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63594bfe-1612-4b3d-a1ab-8185da42cb64 [ 618.923088] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.923088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.923088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.923088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.923088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.923088] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63594bfe-1612-4b3d-a1ab-8185da42cb64 already deleted. [ 618.923088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63594bfe-1612-4b3d-a1ab-8185da42cb64" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.158244] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e03db3b-6528-481b-9c2c-d46eb69f6695 [ 619.158244] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.158244] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.158244] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.158244] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.158244] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.158244] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e03db3b-6528-481b-9c2c-d46eb69f6695 already deleted. [ 619.158244] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e03db3b-6528-481b-9c2c-d46eb69f6695" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.122887] env[69343]: INFO networking_nsxv3.common.synchronization [None req-f42793cb-b4e9-46e9-aea2-3538c1077c45 None None] Enqueued Resource ID: c4b9d67a-a640-43fb-a370-2ee1a7e5cd39 with Priority: HIGHEST for action port [ 620.124178] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4b9d67a-a640-43fb-a370-2ee1a7e5cd39 with Priority: HIGHEST for action port [ 620.124217] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4b9d67a-a640-43fb-a370-2ee1a7e5cd39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.124322] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4b9d67a-a640-43fb-a370-2ee1a7e5cd39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.124649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4b9d67a-a640-43fb-a370-2ee1a7e5cd39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.124889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4b9d67a-a640-43fb-a370-2ee1a7e5cd39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.124977] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4b9d67a-a640-43fb-a370-2ee1a7e5cd39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.166203] env[69343]: INFO networking_nsxv3.common.synchronization [None req-3a550d8a-9bce-4679-8b68-f78910cf3ecd None None] Enqueued Resource ID: 59735179-649f-4d93-85b0-5035d5d55bf2 with Priority: HIGHEST for action port [ 620.166517] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59735179-649f-4d93-85b0-5035d5d55bf2 with Priority: HIGHEST for action port [ 620.167093] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-59735179-649f-4d93-85b0-5035d5d55bf2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.167220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59735179-649f-4d93-85b0-5035d5d55bf2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.167290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59735179-649f-4d93-85b0-5035d5d55bf2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.169509] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59735179-649f-4d93-85b0-5035d5d55bf2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.169607] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59735179-649f-4d93-85b0-5035d5d55bf2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.250515] env[69343]: INFO networking_nsxv3.common.synchronization [None req-cb582229-9570-43a2-9d88-c1760fb0a73c None None] Enqueued Resource ID: a6e3d75b-0f51-4646-be85-d783560d7a37 with Priority: HIGHEST for action port [ 620.250777] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6e3d75b-0f51-4646-be85-d783560d7a37 with Priority: HIGHEST for action port [ 620.251345] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6e3d75b-0f51-4646-be85-d783560d7a37 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.251520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6e3d75b-0f51-4646-be85-d783560d7a37" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.251520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6e3d75b-0f51-4646-be85-d783560d7a37" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.253020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6e3d75b-0f51-4646-be85-d783560d7a37" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.253020] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6e3d75b-0f51-4646-be85-d783560d7a37',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.458732] env[69343]: INFO networking_nsxv3.common.synchronization [None req-ae9b32f4-0827-4412-962a-512bf550edcb None None] Enqueued Resource ID: aceae3c1-6402-4315-9d31-a579da1855ee with Priority: HIGHEST for action port [ 620.459481] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aceae3c1-6402-4315-9d31-a579da1855ee with Priority: HIGHEST for action port [ 620.466026] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-aceae3c1-6402-4315-9d31-a579da1855ee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.466026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aceae3c1-6402-4315-9d31-a579da1855ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.466026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aceae3c1-6402-4315-9d31-a579da1855ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.466026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aceae3c1-6402-4315-9d31-a579da1855ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.466026] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aceae3c1-6402-4315-9d31-a579da1855ee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.629581] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4b9d67a-a640-43fb-a370-2ee1a7e5cd39 [ 620.630250] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.630578] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.630859] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.631309] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.631517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.631723] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4b9d67a-a640-43fb-a370-2ee1a7e5cd39 already deleted. [ 620.635484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4b9d67a-a640-43fb-a370-2ee1a7e5cd39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.671463] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59735179-649f-4d93-85b0-5035d5d55bf2 [ 620.674109] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.674109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.674109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.674109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.674109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.674109] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59735179-649f-4d93-85b0-5035d5d55bf2 already deleted. [ 620.674109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59735179-649f-4d93-85b0-5035d5d55bf2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.755796] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6e3d75b-0f51-4646-be85-d783560d7a37 [ 620.755796] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.755796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.755796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.755796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.755796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.755796] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6e3d75b-0f51-4646-be85-d783560d7a37 already deleted. [ 620.755796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6e3d75b-0f51-4646-be85-d783560d7a37" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.968402] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aceae3c1-6402-4315-9d31-a579da1855ee [ 620.968648] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.968776] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.968842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.969087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.969176] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.969272] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aceae3c1-6402-4315-9d31-a579da1855ee already deleted. [ 620.969352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aceae3c1-6402-4315-9d31-a579da1855ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.789584] env[69343]: INFO networking_nsxv3.common.synchronization [None req-2104b34c-3632-4b0b-b5bf-a6743cd1d8d4 None None] Enqueued Resource ID: f41b7291-baa9-4fa9-8a2e-dcfe17c7b09b with Priority: HIGHEST for action port [ 621.789584] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f41b7291-baa9-4fa9-8a2e-dcfe17c7b09b with Priority: HIGHEST for action port [ 621.789584] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-f41b7291-baa9-4fa9-8a2e-dcfe17c7b09b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.789584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f41b7291-baa9-4fa9-8a2e-dcfe17c7b09b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.789584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f41b7291-baa9-4fa9-8a2e-dcfe17c7b09b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.789584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f41b7291-baa9-4fa9-8a2e-dcfe17c7b09b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.789584] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f41b7291-baa9-4fa9-8a2e-dcfe17c7b09b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.293147] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f41b7291-baa9-4fa9-8a2e-dcfe17c7b09b [ 622.293147] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.293147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.293147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.293147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.293147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.293147] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f41b7291-baa9-4fa9-8a2e-dcfe17c7b09b already deleted. [ 622.293147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f41b7291-baa9-4fa9-8a2e-dcfe17c7b09b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.474784] env[69343]: INFO networking_nsxv3.common.synchronization [None req-492146f2-2488-4de4-9f3b-e02056240821 None None] Enqueued Resource ID: acce97a9-38d1-431c-a3df-210c842f1b98 with Priority: HIGHEST for action port [ 622.475076] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acce97a9-38d1-431c-a3df-210c842f1b98 with Priority: HIGHEST for action port [ 622.475901] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-acce97a9-38d1-431c-a3df-210c842f1b98 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.476057] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acce97a9-38d1-431c-a3df-210c842f1b98" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.476336] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acce97a9-38d1-431c-a3df-210c842f1b98" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.477321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acce97a9-38d1-431c-a3df-210c842f1b98" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.477470] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acce97a9-38d1-431c-a3df-210c842f1b98',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.981421] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port acce97a9-38d1-431c-a3df-210c842f1b98 [ 622.981421] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.981696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.981696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.981808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.981895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.981991] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:acce97a9-38d1-431c-a3df-210c842f1b98 already deleted. [ 622.982093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acce97a9-38d1-431c-a3df-210c842f1b98" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.982970] env[69343]: INFO networking_nsxv3.common.synchronization [req-327ba0f5-5079-4087-b96e-9b1265b73cd2 req-a7722e1f-07dc-4643-b9f1-6ad0c9c5cdae tempest-AttachInterfacesV270Test-1135076339 tempest-AttachInterfacesV270Test-1135076339-project-member] Enqueued Resource ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a with Priority: HIGHEST for action security_group_members [ 622.984357] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a with Priority: HIGHEST for action security_group_members [ 622.984639] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd1700e-14d5-46f1-b054-75d864a0fb1a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.984753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.984820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.985305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.985493] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.985568] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.985622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.985769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.986080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.986190] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd1700e-14d5-46f1-b054-75d864a0fb1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.129629] env[69343]: INFO networking_nsxv3.common.synchronization [None req-c114bac8-d212-422c-a3d1-4bc3b6783eca None None] Enqueued Resource ID: 49368267-7d0b-4e39-810a-61d4f39ef0a5 with Priority: HIGHEST for action port [ 623.130178] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49368267-7d0b-4e39-810a-61d4f39ef0a5 with Priority: HIGHEST for action port [ 623.130710] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-49368267-7d0b-4e39-810a-61d4f39ef0a5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.130855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49368267-7d0b-4e39-810a-61d4f39ef0a5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.130925] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49368267-7d0b-4e39-810a-61d4f39ef0a5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.136652] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49368267-7d0b-4e39-810a-61d4f39ef0a5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.136652] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49368267-7d0b-4e39-810a-61d4f39ef0a5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.138397] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.138397] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.139452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.139452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.139452] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.488777] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.488954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.489416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.489416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.489416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.489558] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.492643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.492643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.492643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.492643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.492643] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a already deleted. [ 623.492643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.568867] env[69343]: INFO networking_nsxv3.common.synchronization [None req-d72bc7a1-0d27-4575-9dcc-e55650b4f1b8 None None] Enqueued Resource ID: f3f850fe-6873-4951-9704-aa7511bb9198 with Priority: HIGHEST for action port [ 623.569033] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3f850fe-6873-4951-9704-aa7511bb9198 with Priority: HIGHEST for action port [ 623.569527] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3f850fe-6873-4951-9704-aa7511bb9198 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.569825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3f850fe-6873-4951-9704-aa7511bb9198" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.569825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3f850fe-6873-4951-9704-aa7511bb9198" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.569937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3f850fe-6873-4951-9704-aa7511bb9198" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.571616] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3f850fe-6873-4951-9704-aa7511bb9198',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.641362] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49368267-7d0b-4e39-810a-61d4f39ef0a5 [ 623.641583] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.641712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.641779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.641996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.642094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.642188] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49368267-7d0b-4e39-810a-61d4f39ef0a5 already deleted. [ 623.642267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49368267-7d0b-4e39-810a-61d4f39ef0a5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.648612] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.812074] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.812323] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.812595] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.812810] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.816243] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.816243] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.816243] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.816243] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.816243] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.816541] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 623.816541] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.816694] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.816745] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.816829] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 623.816934] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.817097] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.839487] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.839653] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 623.839715] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.840524] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.840524] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.840778] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.840845] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.841161] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.842933] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.074663] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3f850fe-6873-4951-9704-aa7511bb9198 [ 624.074934] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.075088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.075162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.075392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.075485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.075585] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3f850fe-6873-4951-9704-aa7511bb9198 already deleted. [ 624.075670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3f850fe-6873-4951-9704-aa7511bb9198" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.135133] env[69343]: INFO networking_nsxv3.common.synchronization [None req-f751d2d8-f804-47a8-bab1-8a65123c2ab0 None None] Enqueued Resource ID: e88a86f3-286e-4648-9fd1-531ccceb6071 with Priority: HIGHEST for action port [ 624.135660] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e88a86f3-286e-4648-9fd1-531ccceb6071 with Priority: HIGHEST for action port [ 624.135957] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-e88a86f3-286e-4648-9fd1-531ccceb6071 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.136089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e88a86f3-286e-4648-9fd1-531ccceb6071" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.136144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e88a86f3-286e-4648-9fd1-531ccceb6071" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.136606] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e88a86f3-286e-4648-9fd1-531ccceb6071" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.136606] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e88a86f3-286e-4648-9fd1-531ccceb6071',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.152053] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.345814] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.346121] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.346355] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.346554] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.346700] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.346861] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b not found, creating... [ 624.347129] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.347335] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.347408] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.347628] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.347752] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.348117] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.348271] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.348589] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.348813] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.348954] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.349116] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b is going to be created. [ 624.377776] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.377776] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.378027] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.378821] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.378821] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.378821] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.639685] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e88a86f3-286e-4648-9fd1-531ccceb6071 [ 624.639685] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.640638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.640638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.640638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.640638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.640638] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e88a86f3-286e-4648-9fd1-531ccceb6071 already deleted. [ 624.640638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e88a86f3-286e-4648-9fd1-531ccceb6071" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.655742] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 624.655742] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 624.657321] env[69343]: INFO networking_nsxv3.common.synchronization [None req-3992e697-7a3e-46e1-a76a-416c248bb62e None None] Enqueued Resource ID: 0d20f889-dd0c-4983-932e-0794e4a2b919 with Priority: HIGHEST for action port [ 624.658384] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d20f889-dd0c-4983-932e-0794e4a2b919 with Priority: HIGHEST for action port [ 624.661267] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d20f889-dd0c-4983-932e-0794e4a2b919 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.661465] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d20f889-dd0c-4983-932e-0794e4a2b919" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.661565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d20f889-dd0c-4983-932e-0794e4a2b919" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.662418] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d20f889-dd0c-4983-932e-0794e4a2b919" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.662418] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d20f889-dd0c-4983-932e-0794e4a2b919',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.072400] env[69343]: INFO networking_nsxv3.common.synchronization [req-97621cc7-0eb2-4946-866c-780678a7a09b req-c9aa6c39-d204-4fe8-b7a0-c394bd530c08 tempest-SecurityGroupRulesTestJSON-260969652 tempest-SecurityGroupRulesTestJSON-260969652-project-member] Enqueued Resource ID: adb1b54d-919f-4556-8257-42276158e454 with Priority: HIGHEST for action security_group_rules [ 625.073032] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb1b54d-919f-4556-8257-42276158e454 with Priority: HIGHEST for action security_group_rules [ 625.073345] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adb1b54d-919f-4556-8257-42276158e454 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.073525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adb1b54d-919f-4556-8257-42276158e454" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.073525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adb1b54d-919f-4556-8257-42276158e454" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.074874] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adb1b54d-919f-4556-8257-42276158e454" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.074874] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adb1b54d-919f-4556-8257-42276158e454',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.166008] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d20f889-dd0c-4983-932e-0794e4a2b919 [ 625.166247] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.166385] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.166473] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.166701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.166793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.170019] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d20f889-dd0c-4983-932e-0794e4a2b919 already deleted. [ 625.170019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d20f889-dd0c-4983-932e-0794e4a2b919" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.472895] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.472895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.472895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.472895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.487754] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 625.488950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.490176] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 625.515951] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.519196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.519196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.519196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.519196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.519196] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 625.519196] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 625.519196] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 625.541178] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.541254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.541817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.541817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.541817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.542112] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 625.571788] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.571930] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.571999] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.572227] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.572329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.572439] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 625.594368] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.594511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.594579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.594968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.594968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.595120] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 625.595176] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 625.595240] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 625.603989] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.604397] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.604502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.604752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.604856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.605350] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adb1b54d-919f-4556-8257-42276158e454 already deleted. [ 625.605464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adb1b54d-919f-4556-8257-42276158e454" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.620832] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.620832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.620832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.620832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.620832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.620832] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 625.620832] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 625.620832] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 625.642522] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.642887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.642887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.642979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.643122] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.643252] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 625.643326] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 625.643400] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 625.643468] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 625.643542] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 625.643605] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 625.643669] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 625.643983] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 625.644065] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 625.644135] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 625.665120] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.665329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.665409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.665667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.665740] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.665829] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 625.690810] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.691846] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.691943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.692302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.692302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.707861] env[69343]: INFO networking_nsxv3.common.synchronization [None req-d76f5e44-7135-4358-af80-43e2c482904d None None] Enqueued Resource ID: f8bb9432-5094-4dfe-95b3-7a3ad667d333 with Priority: HIGHEST for action port [ 625.708176] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8bb9432-5094-4dfe-95b3-7a3ad667d333 with Priority: HIGHEST for action port [ 625.708870] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8bb9432-5094-4dfe-95b3-7a3ad667d333 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.708993] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8bb9432-5094-4dfe-95b3-7a3ad667d333" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.710300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8bb9432-5094-4dfe-95b3-7a3ad667d333" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.710657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8bb9432-5094-4dfe-95b3-7a3ad667d333" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.710750] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8bb9432-5094-4dfe-95b3-7a3ad667d333',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.729878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.876039] env[69343]: INFO networking_nsxv3.common.synchronization [req-327ba0f5-5079-4087-b96e-9b1265b73cd2 req-59b1f516-1f72-4435-8046-5d8fa2936d50 service nova] Enqueued Resource ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a with Priority: HIGHEST for action security_group_rules [ 625.876039] env[69343]: INFO networking_nsxv3.common.synchronization [req-327ba0f5-5079-4087-b96e-9b1265b73cd2 req-59b1f516-1f72-4435-8046-5d8fa2936d50 service nova] Enqueued Resource ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a with Priority: HIGHEST for action security_group_members [ 625.876039] env[69343]: INFO networking_nsxv3.common.synchronization [req-327ba0f5-5079-4087-b96e-9b1265b73cd2 req-59b1f516-1f72-4435-8046-5d8fa2936d50 service nova] Enqueued Resource ID: 97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b with Priority: HIGHEST for action port [ 625.878270] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a with Priority: HIGHEST for action security_group_rules [ 625.878270] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a with Priority: HIGHEST for action security_group_members [ 625.878270] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b with Priority: HIGHEST for action port [ 625.879334] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cd1700e-14d5-46f1-b054-75d864a0fb1a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.879334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.879334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.883046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.883046] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cd1700e-14d5-46f1-b054-75d864a0fb1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.883046] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd1700e-14d5-46f1-b054-75d864a0fb1a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.883046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.883046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.883046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.883046] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.883046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.883046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.883046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.883046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.883046] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd1700e-14d5-46f1-b054-75d864a0fb1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.883553] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.883553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.883649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.887240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.887336] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.212477] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8bb9432-5094-4dfe-95b3-7a3ad667d333 [ 626.212835] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.212924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.213041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.213286] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.213395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.213517] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8bb9432-5094-4dfe-95b3-7a3ad667d333 already deleted. [ 626.213575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8bb9432-5094-4dfe-95b3-7a3ad667d333" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.278783] env[69343]: INFO networking_nsxv3.common.synchronization [req-e5327909-20a5-419e-b14f-3860775accc4 req-e45af7c1-45ae-433f-b68b-5a1901de2149 tempest-ServerDiagnosticsTest-1801058240 tempest-ServerDiagnosticsTest-1801058240-project-member] Enqueued Resource ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 with Priority: HIGHEST for action security_group_members [ 626.278783] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 with Priority: HIGHEST for action security_group_members [ 626.278783] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.279576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.279576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.279576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.279690] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.279832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.279890] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.280036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.280131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.281203] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.389921] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd1700e-14d5-46f1-b054-75d864a0fb1a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.390085] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.391682] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cd1700e-14d5-46f1-b054-75d864a0fb1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.398395] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b with status ACTIVE [ 626.399119] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.400017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.400017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.400017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.402038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.402453] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.402861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.403354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.404409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.404409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.404409] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.405584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.405699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.405864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.406023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.406085] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b is going to be updated. [ 626.427843] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.428548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.428633] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.428856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.428993] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.429169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97bf7b7d-9ec4-4a06-abe9-38fdad0adf3b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.788439] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.788525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.788559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.788799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.788854] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.789075] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.789179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.789241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.789391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.789468] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.789697] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 already deleted. [ 626.789697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.896046] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cd1700e-14d5-46f1-b054-75d864a0fb1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.397988] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.398326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.398326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.398467] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.398571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.398675] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a is going to be created. [ 627.466141] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.469675] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.470198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.470742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.471737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.483286] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a in Status: UNINITIALIZED for 2s [ 627.611283] env[69343]: INFO networking_nsxv3.common.synchronization [None req-0f6cbdd8-ef65-4526-8137-79b68833a1f5 tempest-VolumesAdminNegativeTest-1863638197 tempest-VolumesAdminNegativeTest-1863638197-project-member] Enqueued Resource ID: 67480949-2dd7-420c-b751-f7f48b752f53 with Priority: HIGHEST for action security_group_rules [ 627.611866] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67480949-2dd7-420c-b751-f7f48b752f53 with Priority: HIGHEST for action security_group_rules [ 627.612212] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67480949-2dd7-420c-b751-f7f48b752f53 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.612336] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.612401] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.613033] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.613033] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67480949-2dd7-420c-b751-f7f48b752f53',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.865431] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.865584] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.865702] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.866717] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.866717] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.867475] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.867475] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.868658] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.868826] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.869062] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.869226] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.869442] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.870375] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.870375] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.870375] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.870375] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.889620] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.889807] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 627.889940] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.890150] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.890457] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-23c7b51e-7aa0-4494-9f00-bddf4aa830a5 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.890623] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-23c7b51e-7aa0-4494-9f00-bddf4aa830a5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.890741] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-23c7b51e-7aa0-4494-9f00-bddf4aa830a5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.891065] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-23c7b51e-7aa0-4494-9f00-bddf4aa830a5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.891208] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23c7b51e-7aa0-4494-9f00-bddf4aa830a5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.083122] env[69343]: INFO networking_nsxv3.common.synchronization [None req-3289be40-b629-4b38-a284-c2f372453561 tempest-VolumesAdminNegativeTest-1863638197 tempest-VolumesAdminNegativeTest-1863638197-project-member] Enqueued Resource ID: 67480949-2dd7-420c-b751-f7f48b752f53 with Priority: HIGHEST for action security_group_rules [ 628.083271] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67480949-2dd7-420c-b751-f7f48b752f53 with Priority: HIGHEST for action security_group_rules [ 628.083581] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67480949-2dd7-420c-b751-f7f48b752f53 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.083691] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.135923] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.136096] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.136156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.136438] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.136507] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.136543] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67480949-2dd7-420c-b751-f7f48b752f53 already deleted. [ 628.136626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.137153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.137371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.137404] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67480949-2dd7-420c-b751-f7f48b752f53',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.395518] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.395518] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.395518] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.395867] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.396100] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.398420] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 23c7b51e-7aa0-4494-9f00-bddf4aa830a5 not found, creating... [ 628.398420] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.398420] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.398420] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.398420] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.398420] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.399671] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.399671] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.399671] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.399671] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.399671] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.399671] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 23c7b51e-7aa0-4494-9f00-bddf4aa830a5 is going to be created. [ 628.424339] env[69343]: INFO networking_nsxv3.common.synchronization [req-2e9c5ec4-51a7-4889-a8ce-7b85de1e3c42 req-bbbd6f56-cca5-49f4-bcd3-ad95fe3837bf tempest-ServerExternalEventsTest-237484451 tempest-ServerExternalEventsTest-237484451-project-member] Enqueued Resource ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 with Priority: HIGHEST for action security_group_members [ 628.425548] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.425765] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.426891] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.426891] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.426891] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.426891] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-23c7b51e-7aa0-4494-9f00-bddf4aa830a5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.429030] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 with Priority: HIGHEST for action security_group_members [ 628.432695] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.432695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.432695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.432695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.432695] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.432695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.432695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.432695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.432695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.432695] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d094c60-3a3c-417f-8a4b-5bc3132f56a7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.498037] env[69343]: INFO networking_nsxv3.common.synchronization [None req-cf2da449-515c-47ba-8229-3ee169af3fc2 None None] Enqueued Resource ID: e3404296-6369-4f9a-987f-b8daf05cd1f0 with Priority: HIGHEST for action port [ 628.498037] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3404296-6369-4f9a-987f-b8daf05cd1f0 with Priority: HIGHEST for action port [ 628.498371] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3404296-6369-4f9a-987f-b8daf05cd1f0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.498371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3404296-6369-4f9a-987f-b8daf05cd1f0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.498371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3404296-6369-4f9a-987f-b8daf05cd1f0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.498610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3404296-6369-4f9a-987f-b8daf05cd1f0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.499416] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3404296-6369-4f9a-987f-b8daf05cd1f0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.667436] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.667436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.667436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.667779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.667779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.667779] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67480949-2dd7-420c-b751-f7f48b752f53 already deleted. [ 628.667866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.938733] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.939308] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.939441] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.939784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.940010] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.940371] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.940730] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.940916] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.941239] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.941380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.941560] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 already deleted. [ 628.942386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.007869] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3404296-6369-4f9a-987f-b8daf05cd1f0 [ 629.008465] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.009020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.010416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.010416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.010416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.010416] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3404296-6369-4f9a-987f-b8daf05cd1f0 already deleted. [ 629.010416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3404296-6369-4f9a-987f-b8daf05cd1f0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.467918] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.471723] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.471878] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.472227] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.472536] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.472729] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.472872] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.473137] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.473801] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.473801] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 629.473801] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.473801] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.473801] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.474083] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 629.474083] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.474195] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.494069] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a in Status: SUCCESS [ 629.494323] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.494831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.495087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.495355] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.495355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.495536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.495630] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.495741] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.495801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.495886] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cd1700e-14d5-46f1-b054-75d864a0fb1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.500542] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.501105] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 629.504593] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.504593] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.504593] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-a8262fda-1494-44c1-b534-8e2b9942ac6a taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.504593] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-a8262fda-1494-44c1-b534-8e2b9942ac6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.505030] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-a8262fda-1494-44c1-b534-8e2b9942ac6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.505030] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-a8262fda-1494-44c1-b534-8e2b9942ac6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.505146] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8262fda-1494-44c1-b534-8e2b9942ac6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.008124] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd1700e-14d5-46f1-b054-75d864a0fb1a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.008124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.008124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.008124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.008124] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.008124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.008124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.008124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.008124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.008124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.008745] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd1700e-14d5-46f1-b054-75d864a0fb1a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.008745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.008745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.008745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.008745] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.008745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.008745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.008968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.008968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.009029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.009179] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cd1700e-14d5-46f1-b054-75d864a0fb1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.013023] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.013023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.013023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.013023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.013023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.013023] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port a8262fda-1494-44c1-b534-8e2b9942ac6a not found, creating... [ 630.013023] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.013023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.013023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.013023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.013023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.013536] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.013536] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.013536] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.013536] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.013536] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.013536] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: a8262fda-1494-44c1-b534-8e2b9942ac6a is going to be created. [ 630.035788] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.035788] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.035788] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.035788] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.035788] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.035788] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-a8262fda-1494-44c1-b534-8e2b9942ac6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.515705] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cd1700e-14d5-46f1-b054-75d864a0fb1a: rpc.has_security_group_logging(os_id): False [ 630.534883] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.534883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.534883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.534883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.535164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.535164] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.535248] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.535290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.535440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.535516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.535684] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.535851] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.535851] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.535955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.537073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.537270] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.537434] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.538855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.539410] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.539507] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.539612] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a is going to be created. [ 630.624357] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.624644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.624644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.625034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.625034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.639917] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a in Status: IN_PROGRESS for 2s [ 630.705261] env[69343]: INFO networking_nsxv3.common.synchronization [req-e5327909-20a5-419e-b14f-3860775accc4 req-fbae3871-be2b-48a1-b1e2-d6a0be222caf service nova] Enqueued Resource ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 with Priority: HIGHEST for action security_group_rules [ 630.706241] env[69343]: INFO networking_nsxv3.common.synchronization [req-e5327909-20a5-419e-b14f-3860775accc4 req-fbae3871-be2b-48a1-b1e2-d6a0be222caf service nova] Enqueued Resource ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 with Priority: HIGHEST for action security_group_members [ 630.706241] env[69343]: INFO networking_nsxv3.common.synchronization [req-e5327909-20a5-419e-b14f-3860775accc4 req-fbae3871-be2b-48a1-b1e2-d6a0be222caf service nova] Enqueued Resource ID: 23c7b51e-7aa0-4494-9f00-bddf4aa830a5 with Priority: HIGHEST for action port [ 630.709752] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 with Priority: HIGHEST for action security_group_rules [ 630.709752] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 with Priority: HIGHEST for action security_group_members [ 630.709752] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23c7b51e-7aa0-4494-9f00-bddf4aa830a5 with Priority: HIGHEST for action port [ 630.710603] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.710742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.710804] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.711650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.711650] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.712158] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.712158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.712274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.712416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.712552] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.712646] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.712706] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.714477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.714477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.714591] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.715864] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-23c7b51e-7aa0-4494-9f00-bddf4aa830a5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.715864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23c7b51e-7aa0-4494-9f00-bddf4aa830a5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.715991] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23c7b51e-7aa0-4494-9f00-bddf4aa830a5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.717306] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23c7b51e-7aa0-4494-9f00-bddf4aa830a5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.717306] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23c7b51e-7aa0-4494-9f00-bddf4aa830a5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.088276] env[69343]: INFO networking_nsxv3.common.synchronization [req-52322926-de82-4493-b664-d02b938f066a req-86a9745a-b654-4ccc-9b75-fdddd8ba4f7c tempest-MigrationsAdminTest-544745941 tempest-MigrationsAdminTest-544745941-project-member] Enqueued Resource ID: 1db02b01-820f-4081-802a-12188735ffe1 with Priority: HIGHEST for action security_group_members [ 631.088276] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db02b01-820f-4081-802a-12188735ffe1 with Priority: HIGHEST for action security_group_members [ 631.092459] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db02b01-820f-4081-802a-12188735ffe1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.092459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.092459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.092737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.092998] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.093098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.093098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.093226] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.093315] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.093431] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.118186] env[69343]: INFO networking_nsxv3.common.synchronization [req-62e7ed78-b9b1-41c7-a2dd-dc8f27ceaf44 req-b1d76f8a-3505-45a3-a143-cacc5350325b tempest-SecurityGroupRulesTestJSON-260969652 tempest-SecurityGroupRulesTestJSON-260969652-project-member] Enqueued Resource ID: 77938070-5d79-41cc-a811-ac22f5c9f264 with Priority: HIGHEST for action security_group_rules [ 631.120176] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77938070-5d79-41cc-a811-ac22f5c9f264 with Priority: HIGHEST for action security_group_rules [ 631.121241] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77938070-5d79-41cc-a811-ac22f5c9f264 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.121590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77938070-5d79-41cc-a811-ac22f5c9f264" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.121759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77938070-5d79-41cc-a811-ac22f5c9f264" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.122203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77938070-5d79-41cc-a811-ac22f5c9f264" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.122559] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77938070-5d79-41cc-a811-ac22f5c9f264',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.133732] env[69343]: INFO networking_nsxv3.common.synchronization [req-2e9c5ec4-51a7-4889-a8ce-7b85de1e3c42 req-7c24c5c1-ac1d-4fca-a0cb-63edbf14d88a service nova] Enqueued Resource ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 with Priority: HIGHEST for action security_group_rules [ 631.133990] env[69343]: INFO networking_nsxv3.common.synchronization [req-2e9c5ec4-51a7-4889-a8ce-7b85de1e3c42 req-7c24c5c1-ac1d-4fca-a0cb-63edbf14d88a service nova] Enqueued Resource ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 with Priority: HIGHEST for action security_group_members [ 631.134163] env[69343]: INFO networking_nsxv3.common.synchronization [req-2e9c5ec4-51a7-4889-a8ce-7b85de1e3c42 req-7c24c5c1-ac1d-4fca-a0cb-63edbf14d88a service nova] Enqueued Resource ID: a8262fda-1494-44c1-b534-8e2b9942ac6a with Priority: HIGHEST for action port [ 631.134683] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 with Priority: HIGHEST for action security_group_rules [ 631.134805] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 with Priority: HIGHEST for action security_group_members [ 631.134899] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8262fda-1494-44c1-b534-8e2b9942ac6a with Priority: HIGHEST for action port [ 631.135862] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d094c60-3a3c-417f-8a4b-5bc3132f56a7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.136009] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.136078] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.136970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.136970] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d094c60-3a3c-417f-8a4b-5bc3132f56a7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.137247] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.137700] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.137810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.138023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.138311] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.138412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.138536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.138744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.138793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.138970] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d094c60-3a3c-417f-8a4b-5bc3132f56a7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.140328] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8262fda-1494-44c1-b534-8e2b9942ac6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.140415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8262fda-1494-44c1-b534-8e2b9942ac6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.140467] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8262fda-1494-44c1-b534-8e2b9942ac6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.140886] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8262fda-1494-44c1-b534-8e2b9942ac6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.140886] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8262fda-1494-44c1-b534-8e2b9942ac6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.218313] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.219493] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.219608] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.221123] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23c7b51e-7aa0-4494-9f00-bddf4aa830a5 with status ACTIVE [ 631.221308] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.221431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.221505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.222160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.222160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.222267] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.222325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.222395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.222588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.222673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.222879] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.222997] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.223127] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.223319] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.223406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.223494] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23c7b51e-7aa0-4494-9f00-bddf4aa830a5 is going to be updated. [ 631.252486] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.252601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.252709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.252895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.253715] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.253715] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23c7b51e-7aa0-4494-9f00-bddf4aa830a5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.275606] env[69343]: INFO networking_nsxv3.common.synchronization [None req-bced414a-2ca5-41af-9893-de41e4e3bd56 None None] Enqueued Resource ID: 9b5d0a33-4dc4-42f0-9609-a63c1790e4d9 with Priority: HIGHEST for action port [ 631.276205] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b5d0a33-4dc4-42f0-9609-a63c1790e4d9 with Priority: HIGHEST for action port [ 631.276935] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b5d0a33-4dc4-42f0-9609-a63c1790e4d9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.277085] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b5d0a33-4dc4-42f0-9609-a63c1790e4d9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.277732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b5d0a33-4dc4-42f0-9609-a63c1790e4d9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.277732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b5d0a33-4dc4-42f0-9609-a63c1790e4d9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.277732] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b5d0a33-4dc4-42f0-9609-a63c1790e4d9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.596307] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.596917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.596917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.596917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.596917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.597066] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.597386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.597386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.597504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.597504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.597592] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db02b01-820f-4081-802a-12188735ffe1 already deleted. [ 631.597685] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.642954] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.642954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.643225] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d094c60-3a3c-417f-8a4b-5bc3132f56a7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.644445] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8262fda-1494-44c1-b534-8e2b9942ac6a with status ACTIVE [ 631.644445] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.644445] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.644732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.644823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.644897] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.645105] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.645213] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.645278] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.645520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.645744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.645914] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.646987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.646987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.647222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.647310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.647409] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8262fda-1494-44c1-b534-8e2b9942ac6a is going to be updated. [ 631.649782] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.649963] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.650087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.651156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.651404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.651544] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77938070-5d79-41cc-a811-ac22f5c9f264 already deleted. [ 631.651722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77938070-5d79-41cc-a811-ac22f5c9f264" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.676604] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.677287] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.677545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.679296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.679296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.679296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8262fda-1494-44c1-b534-8e2b9942ac6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.721800] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.782346] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b5d0a33-4dc4-42f0-9609-a63c1790e4d9 [ 631.782584] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.782815] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.782815] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.783021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.783117] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.783220] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b5d0a33-4dc4-42f0-9609-a63c1790e4d9 already deleted. [ 631.783303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b5d0a33-4dc4-42f0-9609-a63c1790e4d9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.152893] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d094c60-3a3c-417f-8a4b-5bc3132f56a7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.225294] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.225586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.225738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.226143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.226378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.226498] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 is going to be created. [ 632.257091] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.257091] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.257091] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.257091] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.257091] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.269486] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 in Status: UNINITIALIZED for 2s [ 632.295703] env[69343]: INFO networking_nsxv3.common.synchronization [None req-b3fa387e-dbf2-4ccf-947f-28b5212f216e tempest-AttachInterfacesUnderV243Test-231606422 tempest-AttachInterfacesUnderV243Test-231606422-project-member] Enqueued Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_rules [ 632.296690] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_rules [ 632.301031] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.301031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.301031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.301031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.301031] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.344561] env[69343]: INFO networking_nsxv3.common.synchronization [None req-e7e0a66b-a96e-435b-be0f-005975208d75 None None] Enqueued Resource ID: 2e23e6a0-64bf-4cc9-af45-b54fced59d3c with Priority: HIGHEST for action port [ 632.346157] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e23e6a0-64bf-4cc9-af45-b54fced59d3c with Priority: HIGHEST for action port [ 632.346796] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e23e6a0-64bf-4cc9-af45-b54fced59d3c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.346956] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e23e6a0-64bf-4cc9-af45-b54fced59d3c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.347042] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e23e6a0-64bf-4cc9-af45-b54fced59d3c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.347407] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e23e6a0-64bf-4cc9-af45-b54fced59d3c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.347488] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e23e6a0-64bf-4cc9-af45-b54fced59d3c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.412162] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.412162] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.415115] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.415115] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.415115] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.417028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.417028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.417028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.417028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.417028] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 632.417028] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 632.417821] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 632.418239] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 632.419016] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 632.419016] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 632.419016] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 632.449160] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 632.449160] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 632.449160] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 632.449160] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.449160] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-e680e5e7-28dd-43af-b1d0-1acd6c820954 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.449160] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-e680e5e7-28dd-43af-b1d0-1acd6c820954" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.449160] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-e680e5e7-28dd-43af-b1d0-1acd6c820954" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.451603] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-e680e5e7-28dd-43af-b1d0-1acd6c820954" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.451603] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e680e5e7-28dd-43af-b1d0-1acd6c820954',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.659238] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a in Status: SUCCESS [ 632.659238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.659514] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.659642] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.664273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.664956] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.664956] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.664956] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 is going to be created. [ 632.697092] env[69343]: INFO networking_nsxv3.common.synchronization [None req-583f90dc-d26e-4060-9626-e1e35efae8cd tempest-AttachInterfacesUnderV243Test-231606422 tempest-AttachInterfacesUnderV243Test-231606422-project-member] Enqueued Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_rules [ 632.697865] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_rules [ 632.697941] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.700695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.704645] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.705085] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.706049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.706049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.706049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.719784] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 in Status: UNINITIALIZED for 2s [ 632.740381] env[69343]: INFO networking_nsxv3.common.synchronization [req-3c88cea7-359f-4aec-a124-8a48b49e4a92 req-956323a9-7c02-435c-abd3-6ff5ba15feec tempest-ImagesTestJSON-628353040 tempest-ImagesTestJSON-628353040-project-member] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 632.740381] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 632.740381] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.740381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.740381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.740381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.740726] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.740726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.740726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.740726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.740904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.740904] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.820667] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.820667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.820667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.820885] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.820919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.821201] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 already deleted. [ 632.821201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.821408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.821408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.821466] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.851069] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e23e6a0-64bf-4cc9-af45-b54fced59d3c [ 632.852024] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.852024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.852024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.854877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.854877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.854877] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e23e6a0-64bf-4cc9-af45-b54fced59d3c already deleted. [ 632.854877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e23e6a0-64bf-4cc9-af45-b54fced59d3c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.956751] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.956751] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.956751] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.956751] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.956751] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.956751] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port e680e5e7-28dd-43af-b1d0-1acd6c820954 not found, creating... [ 632.956751] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.957032] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.957032] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.957265] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.957265] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.957567] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.957761] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.957835] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.959778] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.959778] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.959893] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: e680e5e7-28dd-43af-b1d0-1acd6c820954 is going to be created. [ 632.981320] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.981575] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.981688] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.981967] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.982295] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.982643] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-e680e5e7-28dd-43af-b1d0-1acd6c820954" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.997744] env[69343]: INFO networking_nsxv3.common.synchronization [None req-770f8b5e-364d-4705-8df2-e4ba2c76e5a9 tempest-ServersTestJSON-1071315481 tempest-ServersTestJSON-1071315481-project-member] Enqueued Resource ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 with Priority: HIGHEST for action security_group_rules [ 633.003038] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 with Priority: HIGHEST for action security_group_rules [ 633.003038] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.003038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.003038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.003038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.003038] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fd7d44f-0622-4667-b3c0-6139a73c5a07',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.160411] env[69343]: INFO networking_nsxv3.common.synchronization [None req-f4a5c958-6223-403c-b4a1-7babf559928e None None] Enqueued Resource ID: c950e6f8-a3f5-4e23-b488-087eeefb8b6b with Priority: HIGHEST for action port [ 633.161107] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c950e6f8-a3f5-4e23-b488-087eeefb8b6b with Priority: HIGHEST for action port [ 633.162076] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-c950e6f8-a3f5-4e23-b488-087eeefb8b6b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.162279] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c950e6f8-a3f5-4e23-b488-087eeefb8b6b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.162388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c950e6f8-a3f5-4e23-b488-087eeefb8b6b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.162648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c950e6f8-a3f5-4e23-b488-087eeefb8b6b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.162997] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c950e6f8-a3f5-4e23-b488-087eeefb8b6b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.245176] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.246015] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.246068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.246865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.246865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.246865] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.246865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.246865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.247446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.247446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.247446] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b already deleted. [ 633.247446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.345490] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.345717] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.345717] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.346830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.346830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.346830] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 already deleted. [ 633.346830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.525093] env[69343]: INFO networking_nsxv3.common.synchronization [None req-04666d76-8ce0-45bf-80cc-5b40ee16a506 tempest-ServersTestJSON-1071315481 tempest-ServersTestJSON-1071315481-project-member] Enqueued Resource ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 with Priority: HIGHEST for action security_group_rules [ 633.528032] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.528271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.528686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.528686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.528686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.528813] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 already deleted. [ 633.528813] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.529390] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 with Priority: HIGHEST for action security_group_rules [ 633.529720] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.529840] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.529899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.530103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.530180] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fd7d44f-0622-4667-b3c0-6139a73c5a07',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.559724] env[69343]: INFO networking_nsxv3.common.synchronization [None req-ad0883eb-c83f-41a5-add3-a24e874d39b8 None None] Enqueued Resource ID: 6e0c5506-3cd7-4d81-bde4-dfb38b0572e8 with Priority: HIGHEST for action port [ 633.561062] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e0c5506-3cd7-4d81-bde4-dfb38b0572e8 with Priority: HIGHEST for action port [ 633.562254] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e0c5506-3cd7-4d81-bde4-dfb38b0572e8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.562254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e0c5506-3cd7-4d81-bde4-dfb38b0572e8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.562254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e0c5506-3cd7-4d81-bde4-dfb38b0572e8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.562522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e0c5506-3cd7-4d81-bde4-dfb38b0572e8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.562606] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e0c5506-3cd7-4d81-bde4-dfb38b0572e8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.665815] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c950e6f8-a3f5-4e23-b488-087eeefb8b6b [ 633.666598] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.666598] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.666598] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.667348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.667348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.667348] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c950e6f8-a3f5-4e23-b488-087eeefb8b6b already deleted. [ 633.667348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c950e6f8-a3f5-4e23-b488-087eeefb8b6b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.770573] env[69343]: INFO networking_nsxv3.common.synchronization [None req-73e4df86-35f7-4ffe-881f-5e4434127430 None None] Enqueued Resource ID: 6d8cd0b6-6c02-405c-bec1-4a55e24877d2 with Priority: HIGHEST for action port [ 633.771091] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d8cd0b6-6c02-405c-bec1-4a55e24877d2 with Priority: HIGHEST for action port [ 633.771860] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d8cd0b6-6c02-405c-bec1-4a55e24877d2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.772076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d8cd0b6-6c02-405c-bec1-4a55e24877d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.772557] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d8cd0b6-6c02-405c-bec1-4a55e24877d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.774715] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d8cd0b6-6c02-405c-bec1-4a55e24877d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.774715] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d8cd0b6-6c02-405c-bec1-4a55e24877d2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.926433] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-308 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.927272] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.927272] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.927272] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.928172] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.928172] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.928172] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.928172] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.928172] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.929492] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 633.929492] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.929492] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.929492] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.929492] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 633.929492] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.929492] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.953333] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.953564] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 633.953750] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.954022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.954393] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-4aaac709-7731-4db7-856b-b3f991683d80 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.955101] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-4aaac709-7731-4db7-856b-b3f991683d80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.955101] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-4aaac709-7731-4db7-856b-b3f991683d80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.955226] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-4aaac709-7731-4db7-856b-b3f991683d80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.955376] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aaac709-7731-4db7-856b-b3f991683d80',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.052181] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.052181] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.052348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.052738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.052868] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.053020] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 already deleted. [ 634.053716] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.066440] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e0c5506-3cd7-4d81-bde4-dfb38b0572e8 [ 634.067066] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.067223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.067290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.067496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.067580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.067722] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e0c5506-3cd7-4d81-bde4-dfb38b0572e8 already deleted. [ 634.067807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e0c5506-3cd7-4d81-bde4-dfb38b0572e8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.097906] env[69343]: INFO networking_nsxv3.common.synchronization [None req-1440a011-d280-4815-966c-1a442ca83d02 None None] Enqueued Resource ID: 87e61fb5-9422-4ef1-81a9-6642c1291b02 with Priority: HIGHEST for action port [ 634.098318] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87e61fb5-9422-4ef1-81a9-6642c1291b02 with Priority: HIGHEST for action port [ 634.098886] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-87e61fb5-9422-4ef1-81a9-6642c1291b02 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.099016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87e61fb5-9422-4ef1-81a9-6642c1291b02" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.101466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87e61fb5-9422-4ef1-81a9-6642c1291b02" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.101739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87e61fb5-9422-4ef1-81a9-6642c1291b02" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.101830] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87e61fb5-9422-4ef1-81a9-6642c1291b02',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.279214] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d8cd0b6-6c02-405c-bec1-4a55e24877d2 [ 634.284027] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.284027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.284027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.284027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.284027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.284027] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d8cd0b6-6c02-405c-bec1-4a55e24877d2 already deleted. [ 634.284027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d8cd0b6-6c02-405c-bec1-4a55e24877d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.284027] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 in Status: SUCCESS [ 634.284027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.284027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.284027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.284027] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.284027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.284027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.284027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.284027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.284027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.284027] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.345534] env[69343]: INFO networking_nsxv3.common.synchronization [None req-e9372610-95e5-45f3-99bd-8732a2bd9e47 None None] Enqueued Resource ID: 152f73e3-d3af-48b9-af05-6c4f4fab2212 with Priority: HIGHEST for action port [ 634.346127] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152f73e3-d3af-48b9-af05-6c4f4fab2212 with Priority: HIGHEST for action port [ 634.346434] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-152f73e3-d3af-48b9-af05-6c4f4fab2212 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.346531] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-152f73e3-d3af-48b9-af05-6c4f4fab2212" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.346594] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-152f73e3-d3af-48b9-af05-6c4f4fab2212" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.346839] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-152f73e3-d3af-48b9-af05-6c4f4fab2212" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.348268] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('152f73e3-d3af-48b9-af05-6c4f4fab2212',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.458197] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.458456] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.458648] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.458936] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.459101] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.459469] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 4aaac709-7731-4db7-856b-b3f991683d80 not found, creating... [ 634.459515] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.459770] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.459950] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.460208] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.460383] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.460640] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.460899] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.460899] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.461134] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.461396] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.461396] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 4aaac709-7731-4db7-856b-b3f991683d80 is going to be created. [ 634.485323] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.485520] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.485594] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.487597] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.487934] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.488484] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-4aaac709-7731-4db7-856b-b3f991683d80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.604411] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87e61fb5-9422-4ef1-81a9-6642c1291b02 [ 634.604874] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.604874] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.604874] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.605093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.605200] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.605309] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87e61fb5-9422-4ef1-81a9-6642c1291b02 already deleted. [ 634.605776] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87e61fb5-9422-4ef1-81a9-6642c1291b02" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.654016] env[69343]: INFO networking_nsxv3.common.synchronization [None req-861f6bf9-a3d9-4e2e-807a-50a877a80933 None None] Enqueued Resource ID: e4e40818-3775-4340-9982-a214dbc58fc6 with Priority: HIGHEST for action port [ 634.654269] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4e40818-3775-4340-9982-a214dbc58fc6 with Priority: HIGHEST for action port [ 634.654900] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4e40818-3775-4340-9982-a214dbc58fc6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.655032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4e40818-3775-4340-9982-a214dbc58fc6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.655097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4e40818-3775-4340-9982-a214dbc58fc6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.655345] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4e40818-3775-4340-9982-a214dbc58fc6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.655425] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4e40818-3775-4340-9982-a214dbc58fc6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.730165] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 in Status: SUCCESS [ 634.730482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.730482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.730676] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.730972] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.731061] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.731061] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.731221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.731326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.731381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.731488] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d094c60-3a3c-417f-8a4b-5bc3132f56a7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.786506] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.786649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.786727] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.787024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.787129] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.787335] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.787335] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.787453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.787514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.787659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.788073] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.788073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.788073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.788073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.788208] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.788308] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.788308] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.788480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.789069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.789069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.789069] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.850675] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 152f73e3-d3af-48b9-af05-6c4f4fab2212 [ 634.850675] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.850675] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.850675] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.851757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.852825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.852825] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:152f73e3-d3af-48b9-af05-6c4f4fab2212 already deleted. [ 634.852825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-152f73e3-d3af-48b9-af05-6c4f4fab2212" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.091114] env[69343]: INFO networking_nsxv3.common.synchronization [req-52322926-de82-4493-b664-d02b938f066a req-f0f4ff43-943b-4fff-8ec6-af738cd7a9dd service nova] Enqueued Resource ID: 1db02b01-820f-4081-802a-12188735ffe1 with Priority: HIGHEST for action security_group_rules [ 635.091114] env[69343]: INFO networking_nsxv3.common.synchronization [req-52322926-de82-4493-b664-d02b938f066a req-f0f4ff43-943b-4fff-8ec6-af738cd7a9dd service nova] Enqueued Resource ID: 1db02b01-820f-4081-802a-12188735ffe1 with Priority: HIGHEST for action security_group_members [ 635.091114] env[69343]: INFO networking_nsxv3.common.synchronization [req-52322926-de82-4493-b664-d02b938f066a req-f0f4ff43-943b-4fff-8ec6-af738cd7a9dd service nova] Enqueued Resource ID: e680e5e7-28dd-43af-b1d0-1acd6c820954 with Priority: HIGHEST for action port [ 635.091114] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db02b01-820f-4081-802a-12188735ffe1 with Priority: HIGHEST for action security_group_rules [ 635.091114] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db02b01-820f-4081-802a-12188735ffe1 with Priority: HIGHEST for action security_group_members [ 635.091114] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e680e5e7-28dd-43af-b1d0-1acd6c820954 with Priority: HIGHEST for action port [ 635.091357] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1db02b01-820f-4081-802a-12188735ffe1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.091357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.091357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.092485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.092485] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.094612] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db02b01-820f-4081-802a-12188735ffe1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.094612] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.094714] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.096272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.096272] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.096272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.096272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.096272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.096272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.096272] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.096929] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-e680e5e7-28dd-43af-b1d0-1acd6c820954 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.096929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e680e5e7-28dd-43af-b1d0-1acd6c820954" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.097125] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e680e5e7-28dd-43af-b1d0-1acd6c820954" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.097164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e680e5e7-28dd-43af-b1d0-1acd6c820954" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.097336] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e680e5e7-28dd-43af-b1d0-1acd6c820954',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.157457] env[69343]: INFO networking_nsxv3.common.synchronization [req-eb3670ea-1d08-4647-b489-9051470dacca req-53aee1d4-d2fb-4fd3-b6af-b1e095dbc08e tempest-ImagesNegativeTestJSON-626169961 tempest-ImagesNegativeTestJSON-626169961-project-member] Enqueued Resource ID: c88723a0-b73a-488b-a081-450e868cf48a with Priority: HIGHEST for action security_group_members [ 635.157457] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88723a0-b73a-488b-a081-450e868cf48a with Priority: HIGHEST for action security_group_members [ 635.157637] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88723a0-b73a-488b-a081-450e868cf48a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.157956] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.158177] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.158514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.158859] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.159139] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.159581] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.159909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.160230] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.160441] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c88723a0-b73a-488b-a081-450e868cf48a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.166312] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4e40818-3775-4340-9982-a214dbc58fc6 [ 635.166312] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.166312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.166312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.166312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.166312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.166312] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4e40818-3775-4340-9982-a214dbc58fc6 already deleted. [ 635.166312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4e40818-3775-4340-9982-a214dbc58fc6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.241150] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.243427] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.245442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.245442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.245442] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.245442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.245442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.245442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.245442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.245442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.245442] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.245442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.245442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.246543] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.246829] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.247052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.247202] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.249457] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.249457] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.249457] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.249457] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d094c60-3a3c-417f-8a4b-5bc3132f56a7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.293100] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2: rpc.has_security_group_logging(os_id): False [ 635.320483] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.323302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.323302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.323302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.323302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.323302] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.323746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.323962] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.324293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.327752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.328168] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.328351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.328467] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.328775] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.328930] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.330675] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.332450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.332450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.332450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.332450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.332450] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 is going to be created. [ 635.423842] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.423842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.423842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.423842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.423842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.442849] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 in Status: IN_PROGRESS for 2s [ 635.596561] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db02b01-820f-4081-802a-12188735ffe1 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.596773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.597041] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.599101] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e680e5e7-28dd-43af-b1d0-1acd6c820954 with status ACTIVE [ 635.599311] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.599489] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.599582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.599802] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.599891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.600084] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.600378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.600378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.600490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.600490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.600652] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.600791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.600791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.600932] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.601012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.604133] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e680e5e7-28dd-43af-b1d0-1acd6c820954 is going to be updated. [ 635.636817] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.636972] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.636972] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.639392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.639392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.639392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e680e5e7-28dd-43af-b1d0-1acd6c820954" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.666929] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.666929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.666929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.667554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.667728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.668049] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.668185] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.668289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.668512] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.668826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.668826] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88723a0-b73a-488b-a081-450e868cf48a already deleted. [ 635.669081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.692880] env[69343]: INFO networking_nsxv3.common.synchronization [None req-3a6924f3-e660-488f-aebe-b99d75155b35 None None] Enqueued Resource ID: 3b282bf2-7583-4d0a-8fba-b80c8e49f85d with Priority: HIGHEST for action port [ 635.693545] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b282bf2-7583-4d0a-8fba-b80c8e49f85d with Priority: HIGHEST for action port [ 635.695469] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b282bf2-7583-4d0a-8fba-b80c8e49f85d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.696215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b282bf2-7583-4d0a-8fba-b80c8e49f85d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.696215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b282bf2-7583-4d0a-8fba-b80c8e49f85d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.696353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b282bf2-7583-4d0a-8fba-b80c8e49f85d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.696468] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b282bf2-7583-4d0a-8fba-b80c8e49f85d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.752946] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d094c60-3a3c-417f-8a4b-5bc3132f56a7: rpc.has_security_group_logging(os_id): False [ 635.773393] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.773591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.773959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.773959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.773959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.774165] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.774268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.774330] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.774479] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.774859] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.776092] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.776230] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.776299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.776462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.776538] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.776730] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.776843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.776911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.777019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.777164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.777260] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 is going to be created. [ 635.848536] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.848735] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.848838] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.849037] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.849192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.868439] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 in Status: IN_PROGRESS for 2s [ 636.100756] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.198615] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b282bf2-7583-4d0a-8fba-b80c8e49f85d [ 636.198920] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.199081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.199152] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.199373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.199463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.199607] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b282bf2-7583-4d0a-8fba-b80c8e49f85d already deleted. [ 636.199674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b282bf2-7583-4d0a-8fba-b80c8e49f85d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.482383] env[69343]: INFO networking_nsxv3.common.synchronization [req-3c88cea7-359f-4aec-a124-8a48b49e4a92 req-d589ad99-1b3a-40ec-8a64-a7f2f7cf9755 service nova] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_rules [ 636.482383] env[69343]: INFO networking_nsxv3.common.synchronization [req-3c88cea7-359f-4aec-a124-8a48b49e4a92 req-d589ad99-1b3a-40ec-8a64-a7f2f7cf9755 service nova] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 636.482383] env[69343]: INFO networking_nsxv3.common.synchronization [req-3c88cea7-359f-4aec-a124-8a48b49e4a92 req-d589ad99-1b3a-40ec-8a64-a7f2f7cf9755 service nova] Enqueued Resource ID: 4aaac709-7731-4db7-856b-b3f991683d80 with Priority: HIGHEST for action port [ 636.483865] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_rules [ 636.483865] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 636.484375] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aaac709-7731-4db7-856b-b3f991683d80 with Priority: HIGHEST for action port [ 636.485098] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.485483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.486209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.486404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.486529] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.490285] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.490285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.490285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.490285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.490285] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.490285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.490285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.490285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.490285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.490285] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.493887] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-4aaac709-7731-4db7-856b-b3f991683d80 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.493887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4aaac709-7731-4db7-856b-b3f991683d80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.493887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4aaac709-7731-4db7-856b-b3f991683d80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.494192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4aaac709-7731-4db7-856b-b3f991683d80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.494192] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aaac709-7731-4db7-856b-b3f991683d80',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.603647] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.603865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.603865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.604249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.604249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.604418] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db02b01-820f-4081-802a-12188735ffe1 is going to be created. [ 636.634147] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.634285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.634359] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.634554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.634709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.668848] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db02b01-820f-4081-802a-12188735ffe1 in Status: UNINITIALIZED for 2s [ 636.996523] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.998189] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.998189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.998189] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4aaac709-7731-4db7-856b-b3f991683d80 with status ACTIVE [ 636.998189] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.998189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.998189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.998443] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.998541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.998708] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.998843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.998892] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.000206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.000420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.000564] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.000841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.000841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.000990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.000990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.001122] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4aaac709-7731-4db7-856b-b3f991683d80 is going to be updated. [ 637.024215] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.025454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.025454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.025454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.025454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.025454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4aaac709-7731-4db7-856b-b3f991683d80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.051058] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.051058] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-200" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.051058] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-200" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.051058] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-200" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.051058] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.051058] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.051058] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.051058] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.051058] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.051058] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 637.051058] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 637.051058] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 637.051058] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 637.051622] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 637.051622] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 637.051622] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 637.102429] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 637.102589] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.052 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 637.102852] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 637.102930] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-200" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.103278] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-88d63468-b072-428f-9729-44df330ba0d8 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.103448] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-88d63468-b072-428f-9729-44df330ba0d8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.103567] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-88d63468-b072-428f-9729-44df330ba0d8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.103894] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-88d63468-b072-428f-9729-44df330ba0d8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.104197] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88d63468-b072-428f-9729-44df330ba0d8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.459186] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 in Status: SUCCESS [ 637.459708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.503435] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.608081] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.608425] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.608837] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.609219] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.609478] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.609709] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 88d63468-b072-428f-9729-44df330ba0d8 not found, creating... [ 637.610165] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.610773] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.614025] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.614025] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.614025] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.614025] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.614025] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.614025] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.614025] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.614025] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.614025] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 88d63468-b072-428f-9729-44df330ba0d8 is going to be created. [ 637.667785] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.667994] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.668146] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.668452] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.668743] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.671292] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-88d63468-b072-428f-9729-44df330ba0d8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.822032] env[69343]: INFO networking_nsxv3.common.synchronization [None req-d97442e4-eaf0-4829-b8de-1ff1a94d1bf3 None None] Enqueued Resource ID: 9b9286b6-f2fb-45d7-9578-22e54490a3e1 with Priority: HIGHEST for action port [ 637.822359] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b9286b6-f2fb-45d7-9578-22e54490a3e1 with Priority: HIGHEST for action port [ 637.822985] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b9286b6-f2fb-45d7-9578-22e54490a3e1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.823239] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b9286b6-f2fb-45d7-9578-22e54490a3e1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.823333] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b9286b6-f2fb-45d7-9578-22e54490a3e1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.823623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b9286b6-f2fb-45d7-9578-22e54490a3e1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.823739] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b9286b6-f2fb-45d7-9578-22e54490a3e1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.880017] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 in Status: SUCCESS [ 637.881358] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.006458] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.006884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.006884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.006884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.007151] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.007151] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be created. [ 638.036486] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.038736] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.038736] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.038736] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.038736] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.049330] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: UNINITIALIZED for 2s [ 638.326120] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b9286b6-f2fb-45d7-9578-22e54490a3e1 [ 638.326426] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.326850] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.326850] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.326977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.327019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.327125] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b9286b6-f2fb-45d7-9578-22e54490a3e1 already deleted. [ 638.327257] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b9286b6-f2fb-45d7-9578-22e54490a3e1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.468450] env[69343]: INFO networking_nsxv3.common.synchronization [req-aa89b568-9b42-44c5-a27d-fd7dc31bf1a3 req-2b8381c2-89ba-47c3-8a96-a1ed29f516f3 tempest-DeleteServersAdminTestJSON-2146523094 tempest-DeleteServersAdminTestJSON-2146523094-project-member] Enqueued Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGHEST for action security_group_members [ 638.468927] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGHEST for action security_group_members [ 638.473213] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4754c815-e215-49af-b64e-e52ebe2b915e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.473374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.473444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.473722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.473897] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.474012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.474095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.474272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.474399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.474543] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.702749] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db02b01-820f-4081-802a-12188735ffe1 in Status: SUCCESS [ 638.705494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.705494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.705494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.705494] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.705494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.705494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.705494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.705494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.705494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.705494] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.980023] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.980023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.980023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.980023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.980023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.980023] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.980023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.980023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.980023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.980023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.980023] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4754c815-e215-49af-b64e-e52ebe2b915e already deleted. [ 638.980023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.209383] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db02b01-820f-4081-802a-12188735ffe1 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.210093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.210093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.210093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.210238] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.210576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.210576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.210692] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.210692] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.210789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.211099] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db02b01-820f-4081-802a-12188735ffe1 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.211463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.211463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.211463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.211590] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.212101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.212101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.212101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.212101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.213032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.213032] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.716865] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1db02b01-820f-4081-802a-12188735ffe1: rpc.has_security_group_logging(os_id): False [ 639.739613] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.739857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.739857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.740092] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.740186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.740403] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.740504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.740573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.740732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.740811] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.740996] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.741104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.741183] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.741299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.741373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.741546] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.741637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.741702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.741892] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.741973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.743914] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1db02b01-820f-4081-802a-12188735ffe1 is going to be created. [ 639.824391] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.824532] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.824532] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.825325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.825325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.842783] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db02b01-820f-4081-802a-12188735ffe1 in Status: IN_PROGRESS for 2s [ 639.918726] env[69343]: INFO networking_nsxv3.common.synchronization [None req-b7704846-2e8d-47d7-8dd6-736d25d154f0 None None] Enqueued Resource ID: 71e673e1-b38d-40fb-9b88-7ffc59138c53 with Priority: HIGHEST for action port [ 639.921082] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71e673e1-b38d-40fb-9b88-7ffc59138c53 with Priority: HIGHEST for action port [ 639.921082] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-71e673e1-b38d-40fb-9b88-7ffc59138c53 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.921082] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71e673e1-b38d-40fb-9b88-7ffc59138c53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.921082] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71e673e1-b38d-40fb-9b88-7ffc59138c53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.921082] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71e673e1-b38d-40fb-9b88-7ffc59138c53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.921082] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71e673e1-b38d-40fb-9b88-7ffc59138c53',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.980987] env[69343]: INFO networking_nsxv3.common.synchronization [req-eb3670ea-1d08-4647-b489-9051470dacca req-3c083398-d674-46b0-b8b9-81d3487edd7e service nova] Enqueued Resource ID: c88723a0-b73a-488b-a081-450e868cf48a with Priority: HIGHEST for action security_group_rules [ 639.981228] env[69343]: INFO networking_nsxv3.common.synchronization [req-eb3670ea-1d08-4647-b489-9051470dacca req-3c083398-d674-46b0-b8b9-81d3487edd7e service nova] Enqueued Resource ID: c88723a0-b73a-488b-a081-450e868cf48a with Priority: HIGHEST for action security_group_members [ 639.981398] env[69343]: INFO networking_nsxv3.common.synchronization [req-eb3670ea-1d08-4647-b489-9051470dacca req-3c083398-d674-46b0-b8b9-81d3487edd7e service nova] Enqueued Resource ID: 88d63468-b072-428f-9729-44df330ba0d8 with Priority: HIGHEST for action port [ 639.982014] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88723a0-b73a-488b-a081-450e868cf48a with Priority: HIGHEST for action security_group_rules [ 639.982198] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88723a0-b73a-488b-a081-450e868cf48a with Priority: HIGHEST for action security_group_members [ 639.982342] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88d63468-b072-428f-9729-44df330ba0d8 with Priority: HIGHEST for action port [ 639.982723] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c88723a0-b73a-488b-a081-450e868cf48a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.982867] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.982932] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.983201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.983317] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c88723a0-b73a-488b-a081-450e868cf48a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.984199] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88723a0-b73a-488b-a081-450e868cf48a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.987104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.987104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.987104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.987104] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.987104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.987104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.987104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.987104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.987104] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c88723a0-b73a-488b-a081-450e868cf48a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.987104] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-88d63468-b072-428f-9729-44df330ba0d8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.987104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88d63468-b072-428f-9729-44df330ba0d8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.987104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88d63468-b072-428f-9729-44df330ba0d8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.987104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88d63468-b072-428f-9729-44df330ba0d8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.987104] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88d63468-b072-428f-9729-44df330ba0d8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.061639] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 640.061874] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.062079] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.062383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.062521] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.062761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.062761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.062867] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.063376] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.063376] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.063376] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.290022] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.290022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.290022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.290022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.290022] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.290764] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.291031] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.291664] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.292120] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.292488] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 640.295022] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.295022] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.295022] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.295022] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 640.295022] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.295022] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.311718] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.312176] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 640.312463] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.312748] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.313572] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-b535ad60-412d-44ff-9a16-4dc74167ee27 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.313944] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-b535ad60-412d-44ff-9a16-4dc74167ee27" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.314366] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-b535ad60-412d-44ff-9a16-4dc74167ee27" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.314787] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-b535ad60-412d-44ff-9a16-4dc74167ee27" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.315055] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b535ad60-412d-44ff-9a16-4dc74167ee27',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.422529] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71e673e1-b38d-40fb-9b88-7ffc59138c53 [ 640.423168] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.423168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.423168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.423355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.423355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.423437] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71e673e1-b38d-40fb-9b88-7ffc59138c53 already deleted. [ 640.423516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71e673e1-b38d-40fb-9b88-7ffc59138c53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.490631] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c88723a0-b73a-488b-a081-450e868cf48a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.490631] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88723a0-b73a-488b-a081-450e868cf48a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.490631] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.490631] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88d63468-b072-428f-9729-44df330ba0d8 with status ACTIVE [ 640.490631] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.492079] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.493216] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.493216] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.493216] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.493948] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.493948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.494207] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.494415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.494502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.494775] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.494959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.495390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.495575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.495668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.495991] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88d63468-b072-428f-9729-44df330ba0d8 is going to be updated. [ 640.521138] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.521353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.521460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.521778] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.521926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.522180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88d63468-b072-428f-9729-44df330ba0d8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.565710] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.565861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.565931] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.566173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.566341] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.566448] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.566511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.566666] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.566749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.566833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.566979] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.567079] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.567138] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.567280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.567414] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.567526] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.568358] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.568541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.568629] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.568744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.568847] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.817824] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.818022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.818213] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.818572] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.818810] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.819069] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port b535ad60-412d-44ff-9a16-4dc74167ee27 not found, creating... [ 640.820193] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.820403] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.820537] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.820785] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.820927] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.823722] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.823896] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.824248] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.824891] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.825147] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.826148] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: b535ad60-412d-44ff-9a16-4dc74167ee27 is going to be created. [ 640.846616] env[69343]: INFO networking_nsxv3.common.synchronization [req-d71f3465-c237-4ae5-9757-52065c4f9ab5 req-f4e087b9-ac62-4751-a805-ed5293fe9cbf tempest-SecurityGroupRulesTestJSON-260969652 tempest-SecurityGroupRulesTestJSON-260969652-project-member] Enqueued Resource ID: 8334f34b-4daa-4c63-9efc-8df8ed51b35f with Priority: HIGHEST for action security_group_rules [ 640.848225] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.848424] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.848545] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.848892] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.849178] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.849412] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-b535ad60-412d-44ff-9a16-4dc74167ee27" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.850469] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8334f34b-4daa-4c63-9efc-8df8ed51b35f with Priority: HIGHEST for action security_group_rules [ 640.850798] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8334f34b-4daa-4c63-9efc-8df8ed51b35f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.850891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8334f34b-4daa-4c63-9efc-8df8ed51b35f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.850955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8334f34b-4daa-4c63-9efc-8df8ed51b35f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.851670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8334f34b-4daa-4c63-9efc-8df8ed51b35f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.851752] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8334f34b-4daa-4c63-9efc-8df8ed51b35f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.864730] env[69343]: INFO networking_nsxv3.common.synchronization [None req-262a024d-0af7-4fb8-b428-31ffc9aa6535 None None] Enqueued Resource ID: b3bdd175-cce3-49ec-8d5e-786a65baa357 with Priority: HIGHEST for action port [ 640.864972] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3bdd175-cce3-49ec-8d5e-786a65baa357 with Priority: HIGHEST for action port [ 640.865525] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3bdd175-cce3-49ec-8d5e-786a65baa357 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.865636] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3bdd175-cce3-49ec-8d5e-786a65baa357" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.865711] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3bdd175-cce3-49ec-8d5e-786a65baa357" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.865951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3bdd175-cce3-49ec-8d5e-786a65baa357" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.866426] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3bdd175-cce3-49ec-8d5e-786a65baa357',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.000374] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c88723a0-b73a-488b-a081-450e868cf48a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.072145] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47b39a17-6794-4f6b-b042-45a1e062090b: rpc.has_security_group_logging(os_id): False [ 641.100023] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.100023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.100023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.100023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.100023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.100023] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.100023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.100023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.100023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.100023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.100023] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.100023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.100023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.100023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.100023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.101099] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.101099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.101099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.101099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.101099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.101099] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be created. [ 641.197864] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.198121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.198234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.198492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.198743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.214497] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 641.368965] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3bdd175-cce3-49ec-8d5e-786a65baa357 [ 641.369368] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.369368] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.369491] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.370260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.370260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.370260] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3bdd175-cce3-49ec-8d5e-786a65baa357 already deleted. [ 641.370260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3bdd175-cce3-49ec-8d5e-786a65baa357" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.375365] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.375591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.375591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.376264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.376264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.376264] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8334f34b-4daa-4c63-9efc-8df8ed51b35f already deleted. [ 641.376264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8334f34b-4daa-4c63-9efc-8df8ed51b35f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.462596] env[69343]: INFO networking_nsxv3.common.synchronization [None req-ac34fb87-859c-4b44-806f-beb875b7c9e4 tempest-VolumesAssistedSnapshotsTest-291375593 tempest-VolumesAssistedSnapshotsTest-291375593-project-member] Enqueued Resource ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 with Priority: HIGHEST for action security_group_rules [ 641.465713] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 with Priority: HIGHEST for action security_group_rules [ 641.466432] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ce998c5-dc06-41cd-af9e-8a9554ca2092 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.466603] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.466680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.466948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.467050] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ce998c5-dc06-41cd-af9e-8a9554ca2092',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.502921] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.502921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.502921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.502921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.503217] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.503217] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88723a0-b73a-488b-a081-450e868cf48a is going to be created. [ 641.536876] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.536876] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.536876] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.536876] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.536876] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.551851] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88723a0-b73a-488b-a081-450e868cf48a in Status: UNINITIALIZED for 2s [ 641.688180] env[69343]: INFO networking_nsxv3.common.synchronization [None req-6eace892-9911-4f27-bf2f-e9226d31434b tempest-VolumesAssistedSnapshotsTest-291375593 tempest-VolumesAssistedSnapshotsTest-291375593-project-member] Enqueued Resource ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 with Priority: HIGHEST for action security_group_rules [ 641.688970] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 with Priority: HIGHEST for action security_group_rules [ 641.689380] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ce998c5-dc06-41cd-af9e-8a9554ca2092 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.689592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.711261] env[69343]: INFO networking_nsxv3.common.synchronization [None req-c3127071-8a95-478e-836e-f51c11679ebf None None] Enqueued Resource ID: a86466f6-9d20-4c83-8667-39b5507f4f2a with Priority: HIGHEST for action port [ 641.711261] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86466f6-9d20-4c83-8667-39b5507f4f2a with Priority: HIGHEST for action port [ 641.711261] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-a86466f6-9d20-4c83-8667-39b5507f4f2a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.711261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a86466f6-9d20-4c83-8667-39b5507f4f2a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.711261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a86466f6-9d20-4c83-8667-39b5507f4f2a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.711803] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a86466f6-9d20-4c83-8667-39b5507f4f2a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.712069] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a86466f6-9d20-4c83-8667-39b5507f4f2a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.860585] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db02b01-820f-4081-802a-12188735ffe1 in Status: SUCCESS [ 641.860976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.996765] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.996765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.996765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.996765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.996765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.996765] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 already deleted. [ 641.996765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.996765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.996765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.996765] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ce998c5-dc06-41cd-af9e-8a9554ca2092',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.215010] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a86466f6-9d20-4c83-8667-39b5507f4f2a [ 642.215288] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.215485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.215573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.215759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.215873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.215981] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a86466f6-9d20-4c83-8667-39b5507f4f2a already deleted. [ 642.216084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a86466f6-9d20-4c83-8667-39b5507f4f2a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.347444] env[69343]: INFO networking_nsxv3.common.synchronization [req-aa89b568-9b42-44c5-a27d-fd7dc31bf1a3 req-bb146342-5ef5-42b3-b93d-747c84850111 service nova] Enqueued Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGHEST for action security_group_rules [ 642.347658] env[69343]: INFO networking_nsxv3.common.synchronization [req-aa89b568-9b42-44c5-a27d-fd7dc31bf1a3 req-bb146342-5ef5-42b3-b93d-747c84850111 service nova] Enqueued Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGHEST for action security_group_members [ 642.347812] env[69343]: INFO networking_nsxv3.common.synchronization [req-aa89b568-9b42-44c5-a27d-fd7dc31bf1a3 req-bb146342-5ef5-42b3-b93d-747c84850111 service nova] Enqueued Resource ID: b535ad60-412d-44ff-9a16-4dc74167ee27 with Priority: HIGHEST for action port [ 642.348866] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGHEST for action security_group_rules [ 642.348866] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGHEST for action security_group_members [ 642.348866] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b535ad60-412d-44ff-9a16-4dc74167ee27 with Priority: HIGHEST for action port [ 642.352307] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4754c815-e215-49af-b64e-e52ebe2b915e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.352583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.352583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.352871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.352987] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.354123] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4754c815-e215-49af-b64e-e52ebe2b915e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.354246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.354372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.354552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.354775] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.355468] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.355468] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.355468] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.355468] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.355468] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.357403] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-b535ad60-412d-44ff-9a16-4dc74167ee27 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.357472] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b535ad60-412d-44ff-9a16-4dc74167ee27" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.357570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b535ad60-412d-44ff-9a16-4dc74167ee27" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.357804] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b535ad60-412d-44ff-9a16-4dc74167ee27" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.357865] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b535ad60-412d-44ff-9a16-4dc74167ee27',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.523261] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.523261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.523261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.523261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.523626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.523626] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 already deleted. [ 642.523626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.859460] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4754c815-e215-49af-b64e-e52ebe2b915e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.860485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.860650] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.862484] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b535ad60-412d-44ff-9a16-4dc74167ee27 with status ACTIVE [ 642.862696] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.862878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.863028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.863937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.863937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.864130] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.864250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.864613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.864903] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.864958] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.865473] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.865865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.866348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.866534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.866739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.866910] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b535ad60-412d-44ff-9a16-4dc74167ee27 is going to be updated. [ 642.891119] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.893071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.893071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.893071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.893071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.893454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b535ad60-412d-44ff-9a16-4dc74167ee27" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.158943] env[69343]: INFO networking_nsxv3.common.synchronization [None req-3baf7e27-e32b-4aa1-97ba-89070d78f8c0 tempest-ServersWithSpecificFlavorTestJSON-666360316 tempest-ServersWithSpecificFlavorTestJSON-666360316-project-member] Enqueued Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_rules [ 643.159723] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_rules [ 643.159949] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f3ee775-00c0-4c70-a79b-23338c04f67f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.160084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.160148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.160439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.160601] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.219721] env[69343]: INFO networking_nsxv3.common.synchronization [req-566d0f67-1eb3-4ad2-8561-ea563a30ce43 req-4ac0c17e-1e12-4573-b00d-64048c4c2ef1 tempest-ServersAdminTestJSON-624451732 tempest-ServersAdminTestJSON-624451732-project-member] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 643.220367] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 643.221115] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.221183] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.221295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.222387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.222387] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.222387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.222387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.222387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.223562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.224501] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.232020] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 643.233041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.370015] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.474934] env[69343]: INFO networking_nsxv3.common.synchronization [None req-5469098e-c263-4239-8134-9fae6120edd4 None None] Enqueued Resource ID: 23c3d25f-b88e-492f-82b5-bf4b75af642f with Priority: HIGHEST for action port [ 643.474934] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23c3d25f-b88e-492f-82b5-bf4b75af642f with Priority: HIGHEST for action port [ 643.475721] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-23c3d25f-b88e-492f-82b5-bf4b75af642f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.475818] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23c3d25f-b88e-492f-82b5-bf4b75af642f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.475856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23c3d25f-b88e-492f-82b5-bf4b75af642f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.477630] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23c3d25f-b88e-492f-82b5-bf4b75af642f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.477630] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23c3d25f-b88e-492f-82b5-bf4b75af642f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.564329] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88723a0-b73a-488b-a081-450e868cf48a in Status: SUCCESS [ 643.564587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.564708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.564973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.565128] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.565757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.565757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.565757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.565757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.565929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.565929] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c88723a0-b73a-488b-a081-450e868cf48a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.685088] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.685239] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.685490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.685490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.685589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.685680] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f already deleted. [ 643.685766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.726729] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.726729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.726876] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.726979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.727407] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.727407] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.727407] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.727642] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.727889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.728368] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.728368] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a already deleted. [ 643.728368] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.745148] env[69343]: INFO networking_nsxv3.common.synchronization [None req-93001a5d-e231-4b15-845c-c27ac9e033be tempest-ServersWithSpecificFlavorTestJSON-666360316 tempest-ServersWithSpecificFlavorTestJSON-666360316-project-member] Enqueued Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_rules [ 643.745749] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_rules [ 643.747940] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f3ee775-00c0-4c70-a79b-23338c04f67f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.750981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.750981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.750981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.751093] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.871801] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.872217] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.872523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.873690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.873690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.873690] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4754c815-e215-49af-b64e-e52ebe2b915e is going to be created. [ 643.900834] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.900834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.900834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.900834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.900834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.910204] env[69343]: INFO networking_nsxv3.common.synchronization [None req-1e2745bf-8996-448c-9fb9-fad20a473d8c None None] Enqueued Resource ID: 8e756f2d-216b-4d5a-9e7d-91a60685d97a with Priority: HIGHEST for action port [ 643.915134] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4754c815-e215-49af-b64e-e52ebe2b915e in Status: UNINITIALIZED for 2s [ 643.915662] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e756f2d-216b-4d5a-9e7d-91a60685d97a with Priority: HIGHEST for action port [ 643.915997] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e756f2d-216b-4d5a-9e7d-91a60685d97a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.916142] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e756f2d-216b-4d5a-9e7d-91a60685d97a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.916212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e756f2d-216b-4d5a-9e7d-91a60685d97a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.916483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e756f2d-216b-4d5a-9e7d-91a60685d97a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.916571] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e756f2d-216b-4d5a-9e7d-91a60685d97a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.983928] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23c3d25f-b88e-492f-82b5-bf4b75af642f [ 643.986595] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.986794] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.986858] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.987089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.987213] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.987339] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23c3d25f-b88e-492f-82b5-bf4b75af642f already deleted. [ 643.987442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23c3d25f-b88e-492f-82b5-bf4b75af642f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.068210] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88723a0-b73a-488b-a081-450e868cf48a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.068386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.068429] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.068649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.068865] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.068975] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.069046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.069206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.069290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.069372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.069520] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88723a0-b73a-488b-a081-450e868cf48a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.069606] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.069663] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.069814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.069944] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.070224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.070324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.070951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.070951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.070951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.071133] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c88723a0-b73a-488b-a081-450e868cf48a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.241436] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-621 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.241631] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-621" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.241758] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-621" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.242767] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-621" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.242962] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.243160] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.243320] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.243522] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.243665] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.243880] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 644.243997] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 644.244123] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 644.244234] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 644.244546] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 644.244546] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 644.244642] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 644.273706] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 644.273706] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 644.273706] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 644.273706] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-621" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.273706] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-b2dbdb52-07c7-4bf1-80ed-8113a3aa962f taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.274658] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-b2dbdb52-07c7-4bf1-80ed-8113a3aa962f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.274658] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-b2dbdb52-07c7-4bf1-80ed-8113a3aa962f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.274878] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-b2dbdb52-07c7-4bf1-80ed-8113a3aa962f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.275285] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2dbdb52-07c7-4bf1-80ed-8113a3aa962f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.277767] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.277767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.277767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.277993] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.277993] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.278092] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f already deleted. [ 644.278176] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.420587] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e756f2d-216b-4d5a-9e7d-91a60685d97a [ 644.420587] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.420587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.420587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.420587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.420587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.420587] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e756f2d-216b-4d5a-9e7d-91a60685d97a already deleted. [ 644.420587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e756f2d-216b-4d5a-9e7d-91a60685d97a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.574883] env[69343]: INFO networking_nsxv3.common.synchronization [None req-7188342d-6cc5-4135-a12d-2b1cae6ff01d None None] Enqueued Resource ID: 31420fa1-7eb0-4059-affe-95b0111b92fd with Priority: HIGHEST for action port [ 644.574883] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c88723a0-b73a-488b-a081-450e868cf48a: rpc.has_security_group_logging(os_id): False [ 644.578237] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31420fa1-7eb0-4059-affe-95b0111b92fd with Priority: HIGHEST for action port [ 644.578237] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-31420fa1-7eb0-4059-affe-95b0111b92fd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.578237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31420fa1-7eb0-4059-affe-95b0111b92fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.578237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31420fa1-7eb0-4059-affe-95b0111b92fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.578237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31420fa1-7eb0-4059-affe-95b0111b92fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.578237] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31420fa1-7eb0-4059-affe-95b0111b92fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.606415] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.606415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.606415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.606415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.606415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.606415] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.606415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.606415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.606415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.606415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.606415] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.606415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.606415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.606415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.606415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.606937] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.606937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.606937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.606937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.607137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.609292] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c88723a0-b73a-488b-a081-450e868cf48a is going to be created. [ 644.714729] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.714729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.714729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.715064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.715064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.728822] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c88723a0-b73a-488b-a081-450e868cf48a in Status: IN_PROGRESS for 2s [ 644.780275] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.780761] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.781010] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.781521] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.781820] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.782116] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port b2dbdb52-07c7-4bf1-80ed-8113a3aa962f not found, creating... [ 644.783165] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.783503] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.783590] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.783882] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.784145] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.784654] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.784929] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.785186] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.785589] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.785666] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.785832] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: b2dbdb52-07c7-4bf1-80ed-8113a3aa962f is going to be created. [ 644.830151] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.830262] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.830375] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.830709] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.831017] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.831305] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-b2dbdb52-07c7-4bf1-80ed-8113a3aa962f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.083455] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31420fa1-7eb0-4059-affe-95b0111b92fd [ 645.083718] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.083896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.083896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.084200] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.084310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.084428] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31420fa1-7eb0-4059-affe-95b0111b92fd already deleted. [ 645.084428] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31420fa1-7eb0-4059-affe-95b0111b92fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.128505] env[69343]: INFO networking_nsxv3.common.synchronization [req-37bec5fd-a20c-46b3-b647-48f8c3e17228 req-486b6091-8ef5-4281-baf3-2ae4e083f2f9 tempest-SecurityGroupRulesNegativeTestJSON-1954911372 tempest-SecurityGroupRulesNegativeTestJSON-1954911372-project-member] Enqueued Resource ID: d9fb660c-8d2c-4fbd-9263-1b20dd34b221 with Priority: HIGHEST for action security_group_rules [ 645.129354] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9fb660c-8d2c-4fbd-9263-1b20dd34b221 with Priority: HIGHEST for action security_group_rules [ 645.129451] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9fb660c-8d2c-4fbd-9263-1b20dd34b221 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.129981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9fb660c-8d2c-4fbd-9263-1b20dd34b221" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.129981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9fb660c-8d2c-4fbd-9263-1b20dd34b221" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.129981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9fb660c-8d2c-4fbd-9263-1b20dd34b221" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.129981] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9fb660c-8d2c-4fbd-9263-1b20dd34b221',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.134823] env[69343]: INFO networking_nsxv3.common.synchronization [None req-e52d7bf5-565a-4403-8b8c-9ceda6fc3720 None None] Enqueued Resource ID: e713e13a-757b-40f7-8fb9-6ca0f82bfc69 with Priority: HIGHEST for action port [ 645.134823] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e713e13a-757b-40f7-8fb9-6ca0f82bfc69 with Priority: HIGHEST for action port [ 645.135254] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-e713e13a-757b-40f7-8fb9-6ca0f82bfc69 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.135372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e713e13a-757b-40f7-8fb9-6ca0f82bfc69" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.135434] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e713e13a-757b-40f7-8fb9-6ca0f82bfc69" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.135700] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e713e13a-757b-40f7-8fb9-6ca0f82bfc69" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.135852] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e713e13a-757b-40f7-8fb9-6ca0f82bfc69',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.638283] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e713e13a-757b-40f7-8fb9-6ca0f82bfc69 [ 645.639248] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.639471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.639552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.641770] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.641770] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.641770] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e713e13a-757b-40f7-8fb9-6ca0f82bfc69 already deleted. [ 645.641770] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e713e13a-757b-40f7-8fb9-6ca0f82bfc69" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.655583] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.655805] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.655805] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.656036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.656102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.656221] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9fb660c-8d2c-4fbd-9263-1b20dd34b221 already deleted. [ 645.656318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9fb660c-8d2c-4fbd-9263-1b20dd34b221" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.910938] env[69343]: INFO networking_nsxv3.common.synchronization [req-8df11295-4fc1-4ff8-b269-47d2d118cac7 req-7836e1f3-62e7-443f-8207-570d9765070d tempest-VolumesAdminNegativeTest-1863638197 tempest-VolumesAdminNegativeTest-1863638197-project-member] Enqueued Resource ID: 67480949-2dd7-420c-b751-f7f48b752f53 with Priority: HIGHEST for action security_group_members [ 645.911711] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67480949-2dd7-420c-b751-f7f48b752f53 with Priority: HIGHEST for action security_group_members [ 645.912217] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-67480949-2dd7-420c-b751-f7f48b752f53 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.912217] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.912217] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.912453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.912555] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.912655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.912718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.912973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.913073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.913134] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67480949-2dd7-420c-b751-f7f48b752f53',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.928039] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4754c815-e215-49af-b64e-e52ebe2b915e in Status: SUCCESS [ 645.928039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.928039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.928039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.928039] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.928039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.928039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.928039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.928039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.928039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.928039] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.006239] env[69343]: INFO networking_nsxv3.common.synchronization [req-566d0f67-1eb3-4ad2-8561-ea563a30ce43 req-bb1291ff-c9fd-4290-b54d-0474f03e8206 service nova] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_rules [ 646.006239] env[69343]: INFO networking_nsxv3.common.synchronization [req-566d0f67-1eb3-4ad2-8561-ea563a30ce43 req-bb1291ff-c9fd-4290-b54d-0474f03e8206 service nova] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 646.006239] env[69343]: INFO networking_nsxv3.common.synchronization [req-566d0f67-1eb3-4ad2-8561-ea563a30ce43 req-bb1291ff-c9fd-4290-b54d-0474f03e8206 service nova] Enqueued Resource ID: b2dbdb52-07c7-4bf1-80ed-8113a3aa962f with Priority: HIGHEST for action port [ 646.006239] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_rules [ 646.006239] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 646.006491] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2dbdb52-07c7-4bf1-80ed-8113a3aa962f with Priority: HIGHEST for action port [ 646.006872] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.006988] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.007893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.008208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.008330] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.009260] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.009388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.009454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.009651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.012952] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.012952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.012952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.012952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.012952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.012952] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.012952] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2dbdb52-07c7-4bf1-80ed-8113a3aa962f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.012952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2dbdb52-07c7-4bf1-80ed-8113a3aa962f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.012952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2dbdb52-07c7-4bf1-80ed-8113a3aa962f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.012952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2dbdb52-07c7-4bf1-80ed-8113a3aa962f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.012952] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2dbdb52-07c7-4bf1-80ed-8113a3aa962f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.416148] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.416344] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.416437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.416674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.416810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.417057] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.417188] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.417259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.418041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.418041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.418041] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67480949-2dd7-420c-b751-f7f48b752f53 already deleted. [ 646.418041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.437515] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4754c815-e215-49af-b64e-e52ebe2b915e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.437515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.437515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.437515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.437515] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.437515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.437515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.437515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.437515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.437515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.437515] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4754c815-e215-49af-b64e-e52ebe2b915e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.437515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.438068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.438068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.438068] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.438068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.438213] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.438438] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.438438] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.438539] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.438573] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.513159] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.513319] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.513499] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.514520] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2dbdb52-07c7-4bf1-80ed-8113a3aa962f with status ACTIVE [ 646.514742] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.514957] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.514957] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.515157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.515264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.515470] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.515571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.515632] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.515794] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.515875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.520024] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.520024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.520024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.520024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.520024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.520024] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2dbdb52-07c7-4bf1-80ed-8113a3aa962f is going to be updated. [ 646.547045] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.547726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.547726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.547726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.547876] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.548108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2dbdb52-07c7-4bf1-80ed-8113a3aa962f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.750199] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c88723a0-b73a-488b-a081-450e868cf48a in Status: SUCCESS [ 646.752440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.943284] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4754c815-e215-49af-b64e-e52ebe2b915e: rpc.has_security_group_logging(os_id): False [ 646.984909] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.987153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.987153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.987153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.987153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.987153] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.987153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.987153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.987153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.987153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.987153] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.987153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.987153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.987996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.988219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.988529] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.988857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.989121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.989543] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.989725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.990708] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4754c815-e215-49af-b64e-e52ebe2b915e is going to be created. [ 647.020623] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.099974] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.100183] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.100228] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.100432] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.100638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.116188] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4754c815-e215-49af-b64e-e52ebe2b915e in Status: IN_PROGRESS for 2s [ 647.207444] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-375 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.207636] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-375" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.207763] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-375" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.208146] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-375" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.208418] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.208575] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.208691] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.209185] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.210081] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.210081] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 647.210081] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.210081] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.210081] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.211604] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 647.211787] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.212018] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.244428] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.244675] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 647.244859] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.245143] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-375" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.245685] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-15fbefc1-30e3-4d77-b255-edc26206c6ef taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.245685] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-15fbefc1-30e3-4d77-b255-edc26206c6ef" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.245866] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-15fbefc1-30e3-4d77-b255-edc26206c6ef" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.246154] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-15fbefc1-30e3-4d77-b255-edc26206c6ef" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.246341] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15fbefc1-30e3-4d77-b255-edc26206c6ef',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.527979] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.527979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.527979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.527979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.527979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.527979] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be created. [ 647.559026] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.559026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.559026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.559026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.559026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.569111] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: UNINITIALIZED for 2s [ 647.750244] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.750580] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.750580] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.751706] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.751706] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.751706] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 15fbefc1-30e3-4d77-b255-edc26206c6ef not found, creating... [ 647.751706] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.751706] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.751924] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.752141] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.752955] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.752955] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.752955] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.753224] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.753505] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.754879] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.754879] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 15fbefc1-30e3-4d77-b255-edc26206c6ef is going to be created. [ 647.777212] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.777324] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.777440] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.777789] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.778384] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.778541] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-15fbefc1-30e3-4d77-b255-edc26206c6ef" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.980736] env[69343]: INFO networking_nsxv3.common.synchronization [None req-0ecdb813-9222-430e-b9d4-7842da11d699 None None] Enqueued Resource ID: 8c55e1cd-bb25-485f-9e48-4a9b4a5a0876 with Priority: HIGHEST for action port [ 647.981540] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c55e1cd-bb25-485f-9e48-4a9b4a5a0876 with Priority: HIGHEST for action port [ 647.982080] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c55e1cd-bb25-485f-9e48-4a9b4a5a0876 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.982773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c55e1cd-bb25-485f-9e48-4a9b4a5a0876" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.982773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c55e1cd-bb25-485f-9e48-4a9b4a5a0876" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.982773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c55e1cd-bb25-485f-9e48-4a9b4a5a0876" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.982773] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c55e1cd-bb25-485f-9e48-4a9b4a5a0876',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.161302] env[69343]: INFO networking_nsxv3.common.synchronization [req-6ac82bf9-51f3-498f-903d-29927e61b5a1 req-d36475b0-9df5-4fd8-870a-95c70454e3a2 tempest-ServersAdminTestJSON-624451732 tempest-ServersAdminTestJSON-624451732-project-member] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 648.161302] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 648.161302] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.161302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.246124] env[69343]: INFO networking_nsxv3.common.synchronization [None req-4073c2b2-c121-4371-b200-c2aff825d93f None None] Enqueued Resource ID: 7d9c5d95-25aa-452a-96fc-2499a2bcfe8d with Priority: HIGHEST for action port [ 648.246587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9c5d95-25aa-452a-96fc-2499a2bcfe8d with Priority: HIGHEST for action port [ 648.247462] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d9c5d95-25aa-452a-96fc-2499a2bcfe8d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.248162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d9c5d95-25aa-452a-96fc-2499a2bcfe8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.248162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d9c5d95-25aa-452a-96fc-2499a2bcfe8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.248162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d9c5d95-25aa-452a-96fc-2499a2bcfe8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.248162] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d9c5d95-25aa-452a-96fc-2499a2bcfe8d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.484654] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c55e1cd-bb25-485f-9e48-4a9b4a5a0876 [ 648.485364] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.485364] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.485364] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.485364] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.485542] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.485542] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c55e1cd-bb25-485f-9e48-4a9b4a5a0876 already deleted. [ 648.485607] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c55e1cd-bb25-485f-9e48-4a9b4a5a0876" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.750947] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d9c5d95-25aa-452a-96fc-2499a2bcfe8d [ 648.751982] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.752385] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.752385] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.752600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.752849] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.753036] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d9c5d95-25aa-452a-96fc-2499a2bcfe8d already deleted. [ 648.753215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d9c5d95-25aa-452a-96fc-2499a2bcfe8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.135386] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4754c815-e215-49af-b64e-e52ebe2b915e in Status: SUCCESS [ 649.136092] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.311957] env[69343]: INFO networking_nsxv3.common.synchronization [req-8df11295-4fc1-4ff8-b269-47d2d118cac7 req-fe460ba3-2e63-4b33-9625-749547cc64b8 service nova] Enqueued Resource ID: 67480949-2dd7-420c-b751-f7f48b752f53 with Priority: HIGHEST for action security_group_rules [ 649.311957] env[69343]: INFO networking_nsxv3.common.synchronization [req-8df11295-4fc1-4ff8-b269-47d2d118cac7 req-fe460ba3-2e63-4b33-9625-749547cc64b8 service nova] Enqueued Resource ID: 67480949-2dd7-420c-b751-f7f48b752f53 with Priority: HIGHEST for action security_group_members [ 649.311957] env[69343]: INFO networking_nsxv3.common.synchronization [req-8df11295-4fc1-4ff8-b269-47d2d118cac7 req-fe460ba3-2e63-4b33-9625-749547cc64b8 service nova] Enqueued Resource ID: 15fbefc1-30e3-4d77-b255-edc26206c6ef with Priority: HIGHEST for action port [ 649.312176] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67480949-2dd7-420c-b751-f7f48b752f53 with Priority: HIGHEST for action security_group_rules [ 649.312324] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67480949-2dd7-420c-b751-f7f48b752f53 with Priority: HIGHEST for action security_group_members [ 649.312429] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15fbefc1-30e3-4d77-b255-edc26206c6ef with Priority: HIGHEST for action port [ 649.312699] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67480949-2dd7-420c-b751-f7f48b752f53 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.312845] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.312915] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.314189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.314189] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67480949-2dd7-420c-b751-f7f48b752f53',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.317936] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-67480949-2dd7-420c-b751-f7f48b752f53 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.318087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.318178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.318394] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.319063] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.319063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.319063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.319063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.319063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.319271] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67480949-2dd7-420c-b751-f7f48b752f53',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.322569] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-15fbefc1-30e3-4d77-b255-edc26206c6ef taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.322702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15fbefc1-30e3-4d77-b255-edc26206c6ef" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.322802] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15fbefc1-30e3-4d77-b255-edc26206c6ef" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.323245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15fbefc1-30e3-4d77-b255-edc26206c6ef" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.323245] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15fbefc1-30e3-4d77-b255-edc26206c6ef',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.445352] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-621 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.445825] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-621" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.446103] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-621" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.446509] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-621" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.449874] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.449874] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.449874] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.449874] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.449874] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.449874] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.449874] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.449874] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.449874] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.449874] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.449874] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.449874] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.473075] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.473279] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 649.473426] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.473607] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-621" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.475209] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.475209] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.475209] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.475209] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.475209] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.586609] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: UNINITIALIZED for 4s [ 649.824553] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67480949-2dd7-420c-b751-f7f48b752f53',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.825642] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-67480949-2dd7-420c-b751-f7f48b752f53 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.825752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.826142] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15fbefc1-30e3-4d77-b255-edc26206c6ef with status ACTIVE [ 649.826308] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.826420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.826504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.826698] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.826827] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.827138] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.827379] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.827497] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.827701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.827869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.827985] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.828300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.828397] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.828604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.829589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.829589] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15fbefc1-30e3-4d77-b255-edc26206c6ef is going to be updated. [ 649.851040] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.851197] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.851237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.851505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.851698] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.853012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15fbefc1-30e3-4d77-b255-edc26206c6ef" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.957727] env[69343]: INFO networking_nsxv3.common.synchronization [None req-0b32fda5-dacb-42f5-8722-76b3176a1b72 None None] Enqueued Resource ID: 10337e5b-b238-4435-a1ec-07f13522a51a with Priority: HIGHEST for action port [ 649.957727] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10337e5b-b238-4435-a1ec-07f13522a51a with Priority: HIGHEST for action port [ 649.957727] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-10337e5b-b238-4435-a1ec-07f13522a51a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.959460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10337e5b-b238-4435-a1ec-07f13522a51a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.959875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10337e5b-b238-4435-a1ec-07f13522a51a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.960394] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10337e5b-b238-4435-a1ec-07f13522a51a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.962716] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10337e5b-b238-4435-a1ec-07f13522a51a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.982137] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.982137] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.982137] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.982137] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.982137] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.982137] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d not found, creating... [ 649.982137] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.982137] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.982137] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.982137] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.982137] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.982838] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.984962] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.985378] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.985782] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.986146] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.986616] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d is going to be created. [ 650.021450] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.021450] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.021450] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.021450] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.021450] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.021450] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.326527] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67480949-2dd7-420c-b751-f7f48b752f53',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.463503] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10337e5b-b238-4435-a1ec-07f13522a51a [ 650.464011] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.464011] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.464011] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.464285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.464547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.464547] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10337e5b-b238-4435-a1ec-07f13522a51a already deleted. [ 650.464644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10337e5b-b238-4435-a1ec-07f13522a51a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.537189] env[69343]: INFO networking_nsxv3.common.synchronization [req-b077f6b5-b630-4ecd-bda7-ac7dc852ab3c req-d312fe1d-6b13-47a2-878b-9bbaf496f464 tempest-SecurityGroupRulesTestJSON-260969652 tempest-SecurityGroupRulesTestJSON-260969652-project-member] Enqueued Resource ID: 30f17921-9799-4ea5-b4c2-e1cd358b8617 with Priority: HIGHEST for action security_group_rules [ 650.537786] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30f17921-9799-4ea5-b4c2-e1cd358b8617 with Priority: HIGHEST for action security_group_rules [ 650.538116] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30f17921-9799-4ea5-b4c2-e1cd358b8617 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.538250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30f17921-9799-4ea5-b4c2-e1cd358b8617" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.538313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30f17921-9799-4ea5-b4c2-e1cd358b8617" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.542026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30f17921-9799-4ea5-b4c2-e1cd358b8617" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.542026] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30f17921-9799-4ea5-b4c2-e1cd358b8617',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.562092] env[69343]: INFO networking_nsxv3.common.synchronization [req-c8c150ec-845a-47e6-96f5-de842c895b01 req-321438d4-447d-45de-aae7-b21e498dd217 tempest-ServerExternalEventsTest-237484451 tempest-ServerExternalEventsTest-237484451-project-member] Enqueued Resource ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 with Priority: HIGHEST for action security_group_members [ 650.562860] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 with Priority: HIGHEST for action security_group_members [ 650.565216] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.565216] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.565216] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.565216] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.565385] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.565473] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.565567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.565788] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.565919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.566071] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d094c60-3a3c-417f-8a4b-5bc3132f56a7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.688079] env[69343]: INFO networking_nsxv3.common.synchronization [req-b388e8ee-70b1-4abd-9fbb-c7364df66c7a req-2aa8305a-230a-4b3f-a0e1-2d2fc4a6cf7a tempest-AttachInterfacesUnderV243Test-231606422 tempest-AttachInterfacesUnderV243Test-231606422-project-member] Enqueued Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_members [ 650.690403] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_members [ 650.691078] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.691499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.691955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.692370] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.692696] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.693404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.693404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.693404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.694423] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.694423] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.831293] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.831293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.831293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.831293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.831293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.831293] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67480949-2dd7-420c-b751-f7f48b752f53 is going to be created. [ 650.856205] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.856344] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.856344] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.856517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.856687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.868613] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67480949-2dd7-420c-b751-f7f48b752f53 in Status: UNINITIALIZED for 2s [ 650.944875] env[69343]: INFO networking_nsxv3.common.synchronization [None req-57fe3bfc-3bcc-4e60-8ad2-140aa4f6d008 None None] Enqueued Resource ID: febe2f33-4667-476f-bb17-aed6d8b445f4 with Priority: HIGHEST for action port [ 650.945176] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: febe2f33-4667-476f-bb17-aed6d8b445f4 with Priority: HIGHEST for action port [ 650.945774] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-febe2f33-4667-476f-bb17-aed6d8b445f4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.945901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-febe2f33-4667-476f-bb17-aed6d8b445f4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.945969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-febe2f33-4667-476f-bb17-aed6d8b445f4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.946961] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-febe2f33-4667-476f-bb17-aed6d8b445f4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.947124] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('febe2f33-4667-476f-bb17-aed6d8b445f4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.065540] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.065540] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.065766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.066055] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.066154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.066252] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30f17921-9799-4ea5-b4c2-e1cd358b8617 already deleted. [ 651.066333] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30f17921-9799-4ea5-b4c2-e1cd358b8617" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.068902] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.069049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.069049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.069271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.069305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.070018] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.070018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.070018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.070018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.070018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.070018] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 is going to be updated. [ 651.113239] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.113239] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.113239] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.113239] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.113239] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.125495] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 in Status: IN_PROGRESS for 2s [ 651.198623] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.199725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.200272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.200786] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.201330] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.202844] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.203152] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.203929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.203929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.203929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.203929] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 already deleted. [ 651.203929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.242566] env[69343]: INFO networking_nsxv3.common.synchronization [None req-744a4605-6af3-4725-9518-49db0fd56bf3 None None] Enqueued Resource ID: a6fca790-fdc4-4d89-937f-08e167a1ecf7 with Priority: HIGHEST for action port [ 651.242566] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6fca790-fdc4-4d89-937f-08e167a1ecf7 with Priority: HIGHEST for action port [ 651.244054] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6fca790-fdc4-4d89-937f-08e167a1ecf7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.244368] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6fca790-fdc4-4d89-937f-08e167a1ecf7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.244542] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6fca790-fdc4-4d89-937f-08e167a1ecf7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.244921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6fca790-fdc4-4d89-937f-08e167a1ecf7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.245146] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6fca790-fdc4-4d89-937f-08e167a1ecf7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.296065] env[69343]: INFO networking_nsxv3.common.synchronization [req-6ac82bf9-51f3-498f-903d-29927e61b5a1 req-56373287-4eb9-494c-99c9-8f91532701c5 service nova] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_rules [ 651.297026] env[69343]: INFO networking_nsxv3.common.synchronization [req-6ac82bf9-51f3-498f-903d-29927e61b5a1 req-56373287-4eb9-494c-99c9-8f91532701c5 service nova] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 651.297026] env[69343]: INFO networking_nsxv3.common.synchronization [req-6ac82bf9-51f3-498f-903d-29927e61b5a1 req-56373287-4eb9-494c-99c9-8f91532701c5 service nova] Enqueued Resource ID: 62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d with Priority: HIGHEST for action port [ 651.297512] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_rules [ 651.297962] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 651.298487] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d with Priority: HIGHEST for action port [ 651.301312] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.301312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.301312] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.301312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.301312] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.301312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.301312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.301312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.301312] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.451462] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port febe2f33-4667-476f-bb17-aed6d8b445f4 [ 651.451462] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.451462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.451462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.451462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.451462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.451462] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:febe2f33-4667-476f-bb17-aed6d8b445f4 already deleted. [ 651.451462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-febe2f33-4667-476f-bb17-aed6d8b445f4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.493024] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.493024] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-512" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.493024] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-512" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.493024] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-512" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.493024] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.493820] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.494528] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.495273] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.495582] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.498398] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.498398] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.498398] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.498398] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.498398] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.498398] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.498398] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.521308] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.521308] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 651.521308] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.521308] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-512" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.524044] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.524044] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.524044] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.524044] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.524044] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdb9a5c8-951f-47ce-9085-2662aa3a65c2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.600817] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: SUCCESS [ 651.601264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.601531] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.601801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.602836] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.602836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.602836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.602836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.602836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.603119] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.603833] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.604969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.605295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.606516] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.606763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.606941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.607177] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.607275] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.607446] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.748295] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6fca790-fdc4-4d89-937f-08e167a1ecf7 [ 651.748692] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.749218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.749218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.749218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.749400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.749400] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6fca790-fdc4-4d89-937f-08e167a1ecf7 already deleted. [ 651.749525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6fca790-fdc4-4d89-937f-08e167a1ecf7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.803589] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d with status ACTIVE [ 651.807799] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.807799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.807799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.807799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.807799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.807799] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.807799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.807799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.807799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.807799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.807799] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.807799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.807799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.807799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.807799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.807799] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d is going to be updated. [ 651.845534] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.845534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.845534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.845534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.845534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.845534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62b817c3-b9b9-4c1d-b30e-1ad2bbc35e1d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.027277] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.027277] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.027277] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.027552] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.027686] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.027877] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port cdb9a5c8-951f-47ce-9085-2662aa3a65c2 not found, creating... [ 652.028331] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.028391] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.028739] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.028800] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.029016] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.029535] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.029653] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.029746] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.030023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.030171] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.030388] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: cdb9a5c8-951f-47ce-9085-2662aa3a65c2 is going to be created. [ 652.064066] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.065247] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.065247] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.065247] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.065247] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.065247] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.110125] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.110349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.110481] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.184484] env[69343]: INFO networking_nsxv3.common.synchronization [None req-91129b99-6580-459c-8a35-4fed36026f65 tempest-ServersTestBootFromVolume-1350092508 tempest-ServersTestBootFromVolume-1350092508-project-member] Enqueued Resource ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf with Priority: HIGHEST for action security_group_rules [ 652.185079] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf with Priority: HIGHEST for action security_group_rules [ 652.185417] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f65fedc2-bd86-4b46-8ea8-95f7086801cf taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.185556] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.185614] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.185936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.186034] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f65fedc2-bd86-4b46-8ea8-95f7086801cf',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.229685] env[69343]: INFO networking_nsxv3.common.synchronization [req-4f8ad78e-44f4-4ab7-a5bf-4df1ac18f4a3 req-e88c138b-b33b-43b9-9c72-43ec8f4f66a9 tempest-SecurityGroupRulesNegativeTestJSON-1954911372 tempest-SecurityGroupRulesNegativeTestJSON-1954911372-project-member] Enqueued Resource ID: d9fb660c-8d2c-4fbd-9263-1b20dd34b221 with Priority: HIGHEST for action security_group_rules [ 652.230347] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9fb660c-8d2c-4fbd-9263-1b20dd34b221 with Priority: HIGHEST for action security_group_rules [ 652.231066] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9fb660c-8d2c-4fbd-9263-1b20dd34b221 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.231066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9fb660c-8d2c-4fbd-9263-1b20dd34b221" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.231066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9fb660c-8d2c-4fbd-9263-1b20dd34b221" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.231269] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9fb660c-8d2c-4fbd-9263-1b20dd34b221" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.231269] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9fb660c-8d2c-4fbd-9263-1b20dd34b221',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.357117] env[69343]: INFO networking_nsxv3.common.synchronization [None req-b552faa8-52a6-4ec2-83d1-049165d60632 tempest-ServersTestBootFromVolume-1350092508 tempest-ServersTestBootFromVolume-1350092508-project-member] Enqueued Resource ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf with Priority: HIGHEST for action security_group_rules [ 652.358145] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf with Priority: HIGHEST for action security_group_rules [ 652.358572] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f65fedc2-bd86-4b46-8ea8-95f7086801cf taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.358702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.556233] env[69343]: INFO networking_nsxv3.common.synchronization [None req-bad6c403-5065-417c-aa9a-e9c257303de2 None None] Enqueued Resource ID: 9319ca18-f955-4c9b-8efa-786ff0cc053b with Priority: HIGHEST for action port [ 652.556493] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9319ca18-f955-4c9b-8efa-786ff0cc053b with Priority: HIGHEST for action port [ 652.557118] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-9319ca18-f955-4c9b-8efa-786ff0cc053b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.557245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9319ca18-f955-4c9b-8efa-786ff0cc053b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.557326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9319ca18-f955-4c9b-8efa-786ff0cc053b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.557559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9319ca18-f955-4c9b-8efa-786ff0cc053b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.557640] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9319ca18-f955-4c9b-8efa-786ff0cc053b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.619205] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.708360] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.708527] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.708527] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.708764] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.708865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.708946] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf already deleted. [ 652.709048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.709529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.709702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.709798] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f65fedc2-bd86-4b46-8ea8-95f7086801cf',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.751584] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.751584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.751584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.751584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.751584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.751584] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9fb660c-8d2c-4fbd-9263-1b20dd34b221 already deleted. [ 652.751584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9fb660c-8d2c-4fbd-9263-1b20dd34b221" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.885212] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67480949-2dd7-420c-b751-f7f48b752f53 in Status: SUCCESS [ 652.885212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.885212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.885212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.885212] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.885212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.885212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.885212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.885212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.885212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.885212] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67480949-2dd7-420c-b751-f7f48b752f53',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.065021] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9319ca18-f955-4c9b-8efa-786ff0cc053b [ 653.065307] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.065493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.065530] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.065718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.065795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.065887] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9319ca18-f955-4c9b-8efa-786ff0cc053b already deleted. [ 653.065969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9319ca18-f955-4c9b-8efa-786ff0cc053b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.125203] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.125586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.125586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.125704] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.128027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.128027] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be updated. [ 653.150502] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 in Status: SUCCESS [ 653.150502] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d094c60-3a3c-417f-8a4b-5bc3132f56a7 deletion is rescheduled due to dependency. [ 653.150502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d094c60-3a3c-417f-8a4b-5bc3132f56a7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.166497] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.166674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.166721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.167101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.167101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.178525] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: IN_PROGRESS for 2s [ 653.231114] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.231394] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.231394] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.231677] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.231831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.231831] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf already deleted. [ 653.231957] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.388795] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67480949-2dd7-420c-b751-f7f48b752f53',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.452714] env[69343]: INFO networking_nsxv3.common.synchronization [req-c3a993aa-6b96-463a-bb7f-b92bfad847bd req-ac047a5c-c9ec-4684-9630-cf449229f5e8 tempest-ServersTestJSON-1071315481 tempest-ServersTestJSON-1071315481-project-member] Enqueued Resource ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 with Priority: HIGHEST for action security_group_members [ 653.453243] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 with Priority: HIGHEST for action security_group_members [ 653.453695] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fd7d44f-0622-4667-b3c0-6139a73c5a07 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.453832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.453894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.454854] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.455671] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.455671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.455671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.455671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.455671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.456148] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fd7d44f-0622-4667-b3c0-6139a73c5a07',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.878114] env[69343]: INFO networking_nsxv3.common.synchronization [req-b388e8ee-70b1-4abd-9fbb-c7364df66c7a req-a3967e72-78dc-4da2-9869-648606aa8366 service nova] Enqueued Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_rules [ 653.878114] env[69343]: INFO networking_nsxv3.common.synchronization [req-b388e8ee-70b1-4abd-9fbb-c7364df66c7a req-a3967e72-78dc-4da2-9869-648606aa8366 service nova] Enqueued Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_members [ 653.878114] env[69343]: INFO networking_nsxv3.common.synchronization [req-b388e8ee-70b1-4abd-9fbb-c7364df66c7a req-a3967e72-78dc-4da2-9869-648606aa8366 service nova] Enqueued Resource ID: cdb9a5c8-951f-47ce-9085-2662aa3a65c2 with Priority: HIGHEST for action port [ 653.879379] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_rules [ 653.881680] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_members [ 653.882217] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb9a5c8-951f-47ce-9085-2662aa3a65c2 with Priority: HIGHEST for action port [ 653.883142] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.884286] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.884286] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.886661] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.886661] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.886764] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.887175] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.887275] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.887553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.889063] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.889176] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.889222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.889487] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.889487] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.889487] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.891326] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.891326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.891326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.892025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.892509] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdb9a5c8-951f-47ce-9085-2662aa3a65c2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.894851] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67480949-2dd7-420c-b751-f7f48b752f53: rpc.has_security_group_logging(os_id): False [ 653.926243] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.926243] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.926243] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.926243] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.926243] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.926243] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.926243] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.926243] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.926748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.926748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.926748] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67480949-2dd7-420c-b751-f7f48b752f53 is going to be created. [ 653.959130] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.959295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.959344] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.959625] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.961655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.961655] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.961655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.961655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.961655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.961655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.961655] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 already deleted. [ 653.961655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.067582] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.067870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.067870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.068181] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.068435] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.093629] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67480949-2dd7-420c-b751-f7f48b752f53 in Status: IN_PROGRESS for 2s [ 654.397267] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.399823] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.400517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.401972] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cdb9a5c8-951f-47ce-9085-2662aa3a65c2 with status ACTIVE [ 654.405131] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.405131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.405131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.405131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.405131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.405131] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.405131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.405131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.405131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.405131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.405131] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.405131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.405131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.405131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.405131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.405131] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cdb9a5c8-951f-47ce-9085-2662aa3a65c2 is going to be updated. [ 654.437109] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.437109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.437109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.437109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.437109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.437683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.833449] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-574 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.833656] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-574" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.833808] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-574" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.834192] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-574" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.834452] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.834643] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.834763] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.834989] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.836790] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.837055] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.837204] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.837479] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.837479] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.837617] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.838054] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.838304] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.870724] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.871224] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 654.871525] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.872180] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-574" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.872268] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-ef941e6f-e5ef-4b0b-a529-aa835ccd349f taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.872501] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-ef941e6f-e5ef-4b0b-a529-aa835ccd349f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.872676] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-ef941e6f-e5ef-4b0b-a529-aa835ccd349f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.873144] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-ef941e6f-e5ef-4b0b-a529-aa835ccd349f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.873280] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef941e6f-e5ef-4b0b-a529-aa835ccd349f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.903052] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.971571] env[69343]: INFO networking_nsxv3.common.synchronization [req-13a5dcd7-aa9a-45ef-ab43-4f7d2ea433f0 req-5ad70b63-fef6-4d8b-929e-fc093be9b066 tempest-AttachInterfacesV270Test-1135076339 tempest-AttachInterfacesV270Test-1135076339-project-member] Enqueued Resource ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a with Priority: HIGHEST for action security_group_members [ 654.971571] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a with Priority: HIGHEST for action security_group_members [ 654.971571] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cd1700e-14d5-46f1-b054-75d864a0fb1a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.971571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.971571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.971571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.971571] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.971571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.971571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.971571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.972238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.972479] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cd1700e-14d5-46f1-b054-75d864a0fb1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.990562] env[69343]: INFO networking_nsxv3.common.synchronization [req-5a868e3c-7c73-4d2f-97cc-e9dd24b50f52 req-04df4c8c-6ae8-43e0-a03d-732e58e7760d tempest-ServerDiagnosticsTest-1801058240 tempest-ServerDiagnosticsTest-1801058240-project-member] Enqueued Resource ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 with Priority: HIGHEST for action security_group_members [ 654.991320] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 with Priority: HIGHEST for action security_group_members [ 654.991688] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.991868] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.991983] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.992240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.992456] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.992621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.992727] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.992931] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.993077] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.993218] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.127030] env[69343]: INFO networking_nsxv3.common.synchronization [req-6b303839-0b6b-436b-8a10-141b13604273 req-2315de5e-ba92-460a-8638-c9f2d623b17a tempest-FloatingIPsAssociationNegativeTestJSON-2041735444 tempest-FloatingIPsAssociationNegativeTestJSON-2041735444-project-member] Enqueued Resource ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 with Priority: HIGHEST for action security_group_members [ 655.127620] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 with Priority: HIGHEST for action security_group_members [ 655.128031] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.128166] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.128737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.128737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.128737] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.128737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.129044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.129044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.129110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.129168] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c490ab0a-5a62-4845-ab43-b72f0c00e5c1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.195777] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: SUCCESS [ 655.195777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.195777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.195777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.195777] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.195777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.195777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.195777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.195777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.195777] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.376317] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.376541] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.376602] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.377519] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.377519] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.377674] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port ef941e6f-e5ef-4b0b-a529-aa835ccd349f not found, creating... [ 655.378017] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.378504] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.378504] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.387027] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.387027] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.387027] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.387027] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.387027] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.387027] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.387027] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.387027] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: ef941e6f-e5ef-4b0b-a529-aa835ccd349f is going to be created. [ 655.405712] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.405712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.405712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.405934] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.406067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.406951] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 is going to be created. [ 655.411051] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.414127] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.414329] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.415119] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.415119] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.415276] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-ef941e6f-e5ef-4b0b-a529-aa835ccd349f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.440438] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.440438] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.440438] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.440725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.442842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.454757] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: UNINITIALIZED for 2s [ 655.476502] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.476811] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.476952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.477335] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.477428] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.477648] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.477789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.477857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.478035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.478113] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.478205] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a is going to be updated. [ 655.497968] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.497968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.497968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.498245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.498245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.498350] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.498454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.498532] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.498702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.498769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.499889] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 is going to be updated. [ 655.559749] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.560052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.561749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.562151] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.562396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.564897] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.565315] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.566590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.566590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.566590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.580099] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a in Status: IN_PROGRESS for 2s [ 655.580879] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 in Status: IN_PROGRESS for 2s [ 655.632081] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.632081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.632081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.632081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.632081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.632081] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.632081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.632333] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.632333] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.632401] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.632546] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 already deleted. [ 655.632740] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.702297] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.734113] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-907 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.735890] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-907" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.735890] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-907" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.735890] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-907" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.735890] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.735890] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.735890] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.735890] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.736221] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.736221] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.736418] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.736418] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.736505] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.736618] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.736722] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.737568] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.757135] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.757135] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 655.757295] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.757385] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-907" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.757705] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.757879] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.757997] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.758415] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.758559] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.109197] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67480949-2dd7-420c-b751-f7f48b752f53 in Status: SUCCESS [ 656.109491] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.204728] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.261062] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.261352] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.261429] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.261814] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.262069] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.262329] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8 not found, creating... [ 656.262683] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.263143] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.263373] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.263730] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.263953] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.264342] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.264554] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.264723] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.264977] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.265135] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.265283] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8 is going to be created. [ 656.292500] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.292500] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.292500] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.292500] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.292500] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.292500] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.380341] env[69343]: INFO networking_nsxv3.common.synchronization [req-c3a993aa-6b96-463a-bb7f-b92bfad847bd req-90d640d0-1b65-4403-9b1f-641bcfa4eeb1 service nova] Enqueued Resource ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 with Priority: HIGHEST for action security_group_rules [ 656.382073] env[69343]: INFO networking_nsxv3.common.synchronization [req-c3a993aa-6b96-463a-bb7f-b92bfad847bd req-90d640d0-1b65-4403-9b1f-641bcfa4eeb1 service nova] Enqueued Resource ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 with Priority: HIGHEST for action security_group_members [ 656.382391] env[69343]: INFO networking_nsxv3.common.synchronization [req-c3a993aa-6b96-463a-bb7f-b92bfad847bd req-90d640d0-1b65-4403-9b1f-641bcfa4eeb1 service nova] Enqueued Resource ID: ef941e6f-e5ef-4b0b-a529-aa835ccd349f with Priority: HIGHEST for action port [ 656.383607] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 with Priority: HIGHEST for action security_group_rules [ 656.384615] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 with Priority: HIGHEST for action security_group_members [ 656.388265] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef941e6f-e5ef-4b0b-a529-aa835ccd349f with Priority: HIGHEST for action port [ 656.392219] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.392219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.392219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.392219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.392219] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fd7d44f-0622-4667-b3c0-6139a73c5a07',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.392219] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fd7d44f-0622-4667-b3c0-6139a73c5a07 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.392219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.392219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.392754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.394245] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.394754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.395177] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.395376] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.395468] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.395587] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fd7d44f-0622-4667-b3c0-6139a73c5a07',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.396541] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef941e6f-e5ef-4b0b-a529-aa835ccd349f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.396656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef941e6f-e5ef-4b0b-a529-aa835ccd349f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.396716] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef941e6f-e5ef-4b0b-a529-aa835ccd349f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.397514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef941e6f-e5ef-4b0b-a529-aa835ccd349f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.397514] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef941e6f-e5ef-4b0b-a529-aa835ccd349f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.708153] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.708358] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.708451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.708729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.708869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.709052] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be updated. [ 656.741200] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.741360] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.741448] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.741658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.741847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.752399] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: IN_PROGRESS for 2s [ 656.898427] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0fd7d44f-0622-4667-b3c0-6139a73c5a07',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.899594] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fd7d44f-0622-4667-b3c0-6139a73c5a07 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.899767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.900577] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef941e6f-e5ef-4b0b-a529-aa835ccd349f with status ACTIVE [ 656.900577] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.900577] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.900577] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.900932] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.900932] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.900932] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.901119] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.901119] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.901485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.901485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.901679] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.901679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.901679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.901894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.901951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.902016] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef941e6f-e5ef-4b0b-a529-aa835ccd349f is going to be updated. [ 656.924147] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.924420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.924420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.924669] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.924839] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.925026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef941e6f-e5ef-4b0b-a529-aa835ccd349f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.121146] env[69343]: INFO networking_nsxv3.common.synchronization [req-6b303839-0b6b-436b-8a10-141b13604273 req-414a9d99-0adf-4620-8a51-7bcb37752d26 service nova] Enqueued Resource ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 with Priority: HIGHEST for action security_group_rules [ 657.121667] env[69343]: INFO networking_nsxv3.common.synchronization [req-6b303839-0b6b-436b-8a10-141b13604273 req-414a9d99-0adf-4620-8a51-7bcb37752d26 service nova] Enqueued Resource ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 with Priority: HIGHEST for action security_group_members [ 657.121985] env[69343]: INFO networking_nsxv3.common.synchronization [req-6b303839-0b6b-436b-8a10-141b13604273 req-414a9d99-0adf-4620-8a51-7bcb37752d26 service nova] Enqueued Resource ID: 2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8 with Priority: HIGHEST for action port [ 657.122958] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 with Priority: HIGHEST for action security_group_rules [ 657.123448] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 with Priority: HIGHEST for action security_group_members [ 657.123560] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8 with Priority: HIGHEST for action port [ 657.125483] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c490ab0a-5a62-4845-ab43-b72f0c00e5c1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.125613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.125662] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.125967] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.126077] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c490ab0a-5a62-4845-ab43-b72f0c00e5c1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.128080] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.128080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.128080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.128080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.128080] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.128080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.128080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.128920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.128920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.128920] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c490ab0a-5a62-4845-ab43-b72f0c00e5c1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.130538] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.130703] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.130797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.134159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.134159] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.404252] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0fd7d44f-0622-4667-b3c0-6139a73c5a07',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.466127] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: SUCCESS [ 657.468521] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.469323] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.469628] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.469870] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.470497] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.470588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.470775] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.470872] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.470969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.471092] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.601498] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a in Status: SUCCESS [ 657.601723] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a deletion is rescheduled due to dependency. [ 657.601871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.603147] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 in Status: SUCCESS [ 657.603556] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 deletion is rescheduled due to dependency. [ 657.603692] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.638672] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.638882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.639144] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c490ab0a-5a62-4845-ab43-b72f0c00e5c1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.640338] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8 with status ACTIVE [ 657.640564] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.640695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.640760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.640984] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.641231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.641483] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.641594] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.641672] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.641837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.641924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.643029] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.644670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.644762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.644958] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.645070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.645180] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8 is going to be updated. [ 657.671749] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.671749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.671749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.671749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.671749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.672099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b9b31e9-2a68-4168-a3f8-a8e48c66ecc8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.692981] env[69343]: INFO networking_nsxv3.common.synchronization [req-90f20e71-1a7f-4979-8c81-004bb15db402 req-96ceec53-7066-4ae8-8125-f2084dbe42d4 tempest-InstanceActionsNegativeTestJSON-1465423023 tempest-InstanceActionsNegativeTestJSON-1465423023-project-member] Enqueued Resource ID: 8efad038-46d9-4629-9147-1741df5ffca3 with Priority: HIGHEST for action security_group_members [ 657.692981] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8efad038-46d9-4629-9147-1741df5ffca3 with Priority: HIGHEST for action security_group_members [ 657.692981] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8efad038-46d9-4629-9147-1741df5ffca3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.692981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.692981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.692981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.692981] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.692981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.693351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.693351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.693351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.693351] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8efad038-46d9-4629-9147-1741df5ffca3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.907190] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.907349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.907411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.908726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.908726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.908726] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 is going to be created. [ 657.938058] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.938058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.938058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.938348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.940423] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.953435] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 in Status: UNINITIALIZED for 2s [ 657.974075] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.008128] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-580 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.008385] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-580" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.008516] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-580" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.008988] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-580" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.010140] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.010140] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.010140] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.010591] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.010591] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.010591] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 658.010685] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.010789] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.010892] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.011592] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 658.011592] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.011592] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.035740] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.035961] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 658.036138] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.036320] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-580" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.036645] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-15f739ae-8456-4e9e-bc55-2f14d06ba630 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.036832] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-15f739ae-8456-4e9e-bc55-2f14d06ba630" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.037036] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-15f739ae-8456-4e9e-bc55-2f14d06ba630" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.037419] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-15f739ae-8456-4e9e-bc55-2f14d06ba630" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.037589] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15f739ae-8456-4e9e-bc55-2f14d06ba630',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.147400] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c490ab0a-5a62-4845-ab43-b72f0c00e5c1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.195993] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.196188] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.196238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.196534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.196534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.197523] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.197523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.197523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.197523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.197523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.197523] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8efad038-46d9-4629-9147-1741df5ffca3 already deleted. [ 658.197523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.477897] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c52eea06-29db-49da-b0fb-ebb6ba4a8d86: rpc.has_security_group_logging(os_id): False [ 658.495672] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.495830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.495895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.496094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.496192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.496436] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.496539] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.496597] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.496774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.496857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.497062] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 is going to be created. [ 658.541268] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.541620] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.541767] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.542149] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.542329] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.542501] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 15f739ae-8456-4e9e-bc55-2f14d06ba630 not found, creating... [ 658.542792] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.542959] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.543090] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.543334] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.543476] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.543813] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.544139] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.544265] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.544525] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.544667] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.544812] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 15f739ae-8456-4e9e-bc55-2f14d06ba630 is going to be created. [ 658.564341] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.565112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.565112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.565112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.565329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.578612] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.578930] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.579114] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.579409] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.579652] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.579885] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-15f739ae-8456-4e9e-bc55-2f14d06ba630" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.581822] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: IN_PROGRESS for 2s [ 658.650796] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.651071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.651071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.651440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.651572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.651645] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 is going to be created. [ 658.698084] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.698294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.698342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.698604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.698705] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.747726] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 in Status: UNINITIALIZED for 2s [ 658.772779] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: SUCCESS [ 658.772779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.772779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.772992] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.773295] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.773477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.773693] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.773817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.773954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.774118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.774385] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.774550] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.774694] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.774968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.775227] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.775371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.775466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.775693] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.775815] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.775947] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.776096] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.967831] env[69343]: INFO networking_nsxv3.common.synchronization [req-382ab73e-2c83-4bf6-ac15-37f19298d2f1 req-587239bd-ccf8-4caa-b98f-faddc56c922b tempest-ImagesNegativeTestJSON-626169961 tempest-ImagesNegativeTestJSON-626169961-project-member] Enqueued Resource ID: c88723a0-b73a-488b-a081-450e868cf48a with Priority: HIGHEST for action security_group_members [ 658.971610] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88723a0-b73a-488b-a081-450e868cf48a with Priority: HIGHEST for action security_group_members [ 658.971610] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88723a0-b73a-488b-a081-450e868cf48a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.971610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.971610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.971610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.971610] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.971610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.971610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.971610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.971610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.971610] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c88723a0-b73a-488b-a081-450e868cf48a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.278859] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a: rpc.has_security_group_logging(os_id): False [ 659.301352] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.301352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.301352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.301352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.301352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.301352] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.301352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.301352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.301352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.301352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.301352] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.301352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.301352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.301352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.301352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.302025] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.302025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.302025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.303937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.304873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.304873] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be created. [ 659.339393] env[69343]: INFO networking_nsxv3.common.synchronization [req-90f20e71-1a7f-4979-8c81-004bb15db402 req-ff15e639-c88f-44a5-aedc-da2cce1f3b6c service nova] Enqueued Resource ID: 8efad038-46d9-4629-9147-1741df5ffca3 with Priority: HIGHEST for action security_group_rules [ 659.339561] env[69343]: INFO networking_nsxv3.common.synchronization [req-90f20e71-1a7f-4979-8c81-004bb15db402 req-ff15e639-c88f-44a5-aedc-da2cce1f3b6c service nova] Enqueued Resource ID: 8efad038-46d9-4629-9147-1741df5ffca3 with Priority: HIGHEST for action security_group_members [ 659.339697] env[69343]: INFO networking_nsxv3.common.synchronization [req-90f20e71-1a7f-4979-8c81-004bb15db402 req-ff15e639-c88f-44a5-aedc-da2cce1f3b6c service nova] Enqueued Resource ID: 15f739ae-8456-4e9e-bc55-2f14d06ba630 with Priority: HIGHEST for action port [ 659.340558] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8efad038-46d9-4629-9147-1741df5ffca3 with Priority: HIGHEST for action security_group_rules [ 659.340558] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8efad038-46d9-4629-9147-1741df5ffca3 with Priority: HIGHEST for action security_group_members [ 659.340645] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15f739ae-8456-4e9e-bc55-2f14d06ba630 with Priority: HIGHEST for action port [ 659.340842] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8efad038-46d9-4629-9147-1741df5ffca3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.340967] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.341048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.342209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.342209] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8efad038-46d9-4629-9147-1741df5ffca3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.342355] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8efad038-46d9-4629-9147-1741df5ffca3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.342355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.342469] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.342604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.342736] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.345920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.345920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.345920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.345920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.345920] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8efad038-46d9-4629-9147-1741df5ffca3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.345920] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-15f739ae-8456-4e9e-bc55-2f14d06ba630 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.345920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15f739ae-8456-4e9e-bc55-2f14d06ba630" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.345920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15f739ae-8456-4e9e-bc55-2f14d06ba630" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.345920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15f739ae-8456-4e9e-bc55-2f14d06ba630" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.345920] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15f739ae-8456-4e9e-bc55-2f14d06ba630',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.369162] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.369334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.369453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.369606] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.369794] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.383739] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: IN_PROGRESS for 2s [ 659.475313] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.475675] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.475675] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.475809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.475846] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.476070] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.476211] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.476211] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.476358] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.476436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.476519] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88723a0-b73a-488b-a081-450e868cf48a is going to be updated. [ 659.527223] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.527523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.527697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.528074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.528310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.547934] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88723a0-b73a-488b-a081-450e868cf48a in Status: IN_PROGRESS for 2s [ 659.847282] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8efad038-46d9-4629-9147-1741df5ffca3 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.847282] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.847704] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8efad038-46d9-4629-9147-1741df5ffca3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.850224] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15f739ae-8456-4e9e-bc55-2f14d06ba630 with status ACTIVE [ 659.850425] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.850547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.850677] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.850833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.850923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.851101] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.851197] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.851260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.851441] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.851522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.853687] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.853687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.853687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.853687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.853687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.853687] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15f739ae-8456-4e9e-bc55-2f14d06ba630 is going to be updated. [ 659.876480] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.876480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.876480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.876480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.876480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.876732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15f739ae-8456-4e9e-bc55-2f14d06ba630" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.932222] env[69343]: INFO networking_nsxv3.common.synchronization [req-42aa45d2-cba1-4f18-b4aa-085a3a5c446d req-3f35f0da-1a68-474b-9e2f-d2d513ae4957 tempest-SecurityGroupRulesTestJSON-260969652 tempest-SecurityGroupRulesTestJSON-260969652-project-member] Enqueued Resource ID: e4bd4c24-f975-4a6f-ac64-1446bedef6d0 with Priority: HIGHEST for action security_group_rules [ 659.932875] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4bd4c24-f975-4a6f-ac64-1446bedef6d0 with Priority: HIGHEST for action security_group_rules [ 659.933236] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4bd4c24-f975-4a6f-ac64-1446bedef6d0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.933369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4bd4c24-f975-4a6f-ac64-1446bedef6d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.933421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4bd4c24-f975-4a6f-ac64-1446bedef6d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.933695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4bd4c24-f975-4a6f-ac64-1446bedef6d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.933773] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4bd4c24-f975-4a6f-ac64-1446bedef6d0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.975231] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 in Status: SUCCESS [ 659.975501] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.975677] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.975902] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.976132] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.976259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.976324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.976493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.976602] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.976696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.976785] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0fd7d44f-0622-4667-b3c0-6139a73c5a07',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.350290] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8efad038-46d9-4629-9147-1741df5ffca3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.455037] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.455253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.455253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.455569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.455569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.455652] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4bd4c24-f975-4a6f-ac64-1446bedef6d0 already deleted. [ 660.455764] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4bd4c24-f975-4a6f-ac64-1446bedef6d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.481952] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0fd7d44f-0622-4667-b3c0-6139a73c5a07',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.512648] env[69343]: INFO networking_nsxv3.common.synchronization [req-0f64d192-8286-41b4-b6f2-c1a1a7e95d88 req-76cc9944-1c7f-4bcd-a37f-b8dfc5d1e7cb tempest-VolumesAssistedSnapshotsTest-291375593 tempest-VolumesAssistedSnapshotsTest-291375593-project-member] Enqueued Resource ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 with Priority: HIGHEST for action security_group_members [ 660.512648] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 with Priority: HIGHEST for action security_group_members [ 660.512648] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce998c5-dc06-41cd-af9e-8a9554ca2092 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.512871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.512871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.513432] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.513633] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.513762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.513839] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.514039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.514174] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.514233] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce998c5-dc06-41cd-af9e-8a9554ca2092',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.595483] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: SUCCESS [ 660.595757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.762315] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 in Status: SUCCESS [ 660.762477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.762679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.763791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.763791] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.763791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.763791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.763791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.764588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.764706] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.764823] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c490ab0a-5a62-4845-ab43-b72f0c00e5c1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.854580] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.854830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.854830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.855048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.855170] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.855326] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8efad038-46d9-4629-9147-1741df5ffca3 is going to be created. [ 660.885505] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.887861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.887861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.887861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.887861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.898786] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8efad038-46d9-4629-9147-1741df5ffca3 in Status: UNINITIALIZED for 2s [ 660.988791] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0fd7d44f-0622-4667-b3c0-6139a73c5a07: rpc.has_security_group_logging(os_id): False [ 661.005708] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.005907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.005907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.006264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.006264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.006463] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.006561] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.006742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.006781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.006837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.006920] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 is going to be created. [ 661.016314] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.016869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.016869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.016869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.016869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.017104] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.017183] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.017243] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.017392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.018149] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.018149] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 already deleted. [ 661.018149] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.073214] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.073214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.073214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.073214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.073214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.086527] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 in Status: IN_PROGRESS for 2s [ 661.267052] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.267256] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.267330] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.267554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.267732] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.267980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.267980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.268094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.268149] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.268226] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.268378] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.268469] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.268560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.268672] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.268804] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.268891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.269031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.269332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.269447] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.269555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.269655] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c490ab0a-5a62-4845-ab43-b72f0c00e5c1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.304706] env[69343]: INFO networking_nsxv3.common.synchronization [req-92eb3f30-4019-4364-bd03-35133a748a53 req-eb47d3d9-557c-4469-a048-d2a59a5d3b4d tempest-DeleteServersAdminTestJSON-1665479652 tempest-DeleteServersAdminTestJSON-1665479652-project-admin] Enqueued Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGHEST for action security_group_members [ 661.304706] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGHEST for action security_group_members [ 661.304706] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4754c815-e215-49af-b64e-e52ebe2b915e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.304965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.304965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.305758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.306684] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.306684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.306684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.307074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.307074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.307074] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.398788] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: SUCCESS [ 661.399088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.399362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.399526] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.399611] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.464701] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-234 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.464701] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-234" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.464701] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-234" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.464701] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-234" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.464904] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.465162] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.465327] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.465570] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.465713] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.465918] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.466039] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.466146] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.466255] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.466360] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.466462] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.466601] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.489040] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.489040] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 661.489040] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.489040] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-234" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.489040] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.489040] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.489040] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.489040] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.489040] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.561847] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88723a0-b73a-488b-a081-450e868cf48a in Status: SUCCESS [ 661.561949] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88723a0-b73a-488b-a081-450e868cf48a deletion is rescheduled due to dependency. [ 661.562083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88723a0-b73a-488b-a081-450e868cf48a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.772354] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c490ab0a-5a62-4845-ab43-b72f0c00e5c1: rpc.has_security_group_logging(os_id): False [ 661.796354] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.796354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.796354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.796354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.796354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.796354] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.796354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.796354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.796354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.796354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.797021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.797170] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.797240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.797422] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.797501] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.797696] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.797801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.797847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.801365] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.801534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.801653] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 is going to be created. [ 661.810749] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.810868] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.811528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.811528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.811528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.811528] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.811851] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.811851] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.811851] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.812066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.812066] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4754c815-e215-49af-b64e-e52ebe2b915e is going to be updated. [ 661.852543] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.852711] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.852757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.852988] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.853459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.866517] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4754c815-e215-49af-b64e-e52ebe2b915e in Status: IN_PROGRESS for 2s [ 661.878188] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.878388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.878449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.878649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.878844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.893390] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 in Status: IN_PROGRESS for 2s [ 661.903351] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.903527] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.903576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.903803] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.903947] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.904070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.904139] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.904298] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.904618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.904618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.904618] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.992368] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.992684] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.992815] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.993123] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.993292] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.993509] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae not found, creating... [ 661.993825] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.993995] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.994143] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.994400] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.994531] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.996711] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.996711] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.996711] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.996711] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.996711] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.996711] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae is going to be created. [ 662.031285] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.031507] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.031641] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.031925] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.032203] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.032450] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.409310] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.409668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.409668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.409775] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.409980] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.410130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.410201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.410371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.410467] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.410564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.410722] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.410823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.410887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.411056] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.411205] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.411328] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.411386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.411489] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.411575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.411662] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.411757] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.453044] env[69343]: INFO networking_nsxv3.common.synchronization [req-078484d7-34f1-466f-96ac-221d7a0b97eb req-d96a8860-f71a-4aa1-9f6d-d0cf8c0d956a tempest-SecurityGroupRulesTestJSON-260969652 tempest-SecurityGroupRulesTestJSON-260969652-project-member] Enqueued Resource ID: e4bd4c24-f975-4a6f-ac64-1446bedef6d0 with Priority: HIGHEST for action security_group_rules [ 662.454250] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4bd4c24-f975-4a6f-ac64-1446bedef6d0 with Priority: HIGHEST for action security_group_rules [ 662.454740] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4bd4c24-f975-4a6f-ac64-1446bedef6d0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.455766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4bd4c24-f975-4a6f-ac64-1446bedef6d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.455766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4bd4c24-f975-4a6f-ac64-1446bedef6d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.455766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4bd4c24-f975-4a6f-ac64-1446bedef6d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.455766] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4bd4c24-f975-4a6f-ac64-1446bedef6d0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.909277] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8efad038-46d9-4629-9147-1741df5ffca3 in Status: SUCCESS [ 662.909588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.909773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.909905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.910119] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.910241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.910307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.910502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.910556] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.910608] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.910703] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8efad038-46d9-4629-9147-1741df5ffca3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.918614] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a: rpc.has_security_group_logging(os_id): False [ 662.935532] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.935697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.935770] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.936075] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.936213] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.936575] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.936781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.937477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.937477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.937477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.937741] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.937869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.937938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.938703] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.938703] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.938703] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.938703] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.939118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.939118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.939118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.939118] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be updated. [ 662.982081] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.982321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.982321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.982754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.982858] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.982959] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4bd4c24-f975-4a6f-ac64-1446bedef6d0 already deleted. [ 662.983071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4bd4c24-f975-4a6f-ac64-1446bedef6d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.048179] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.048179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.048179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.048179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.049672] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.068474] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: IN_PROGRESS for 2s [ 663.108937] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 in Status: SUCCESS [ 663.109572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.272140] env[69343]: INFO networking_nsxv3.common.synchronization [req-0f64d192-8286-41b4-b6f2-c1a1a7e95d88 req-13968106-63a0-4dac-8504-4e90226f70ea service nova] Enqueued Resource ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 with Priority: HIGHEST for action security_group_rules [ 663.272285] env[69343]: INFO networking_nsxv3.common.synchronization [req-0f64d192-8286-41b4-b6f2-c1a1a7e95d88 req-13968106-63a0-4dac-8504-4e90226f70ea service nova] Enqueued Resource ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 with Priority: HIGHEST for action security_group_members [ 663.272425] env[69343]: INFO networking_nsxv3.common.synchronization [req-0f64d192-8286-41b4-b6f2-c1a1a7e95d88 req-13968106-63a0-4dac-8504-4e90226f70ea service nova] Enqueued Resource ID: e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae with Priority: HIGHEST for action port [ 663.272652] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 with Priority: HIGHEST for action security_group_rules [ 663.272801] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 with Priority: HIGHEST for action security_group_members [ 663.272900] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae with Priority: HIGHEST for action port [ 663.274195] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ce998c5-dc06-41cd-af9e-8a9554ca2092 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.274195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.274195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.274480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.274480] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ce998c5-dc06-41cd-af9e-8a9554ca2092',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.275279] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce998c5-dc06-41cd-af9e-8a9554ca2092 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.275457] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.275457] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.275700] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.275793] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.275888] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.276222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.276222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.276222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.276392] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce998c5-dc06-41cd-af9e-8a9554ca2092',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.277610] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.277741] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.277808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.278481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.278573] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.413508] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8efad038-46d9-4629-9147-1741df5ffca3 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.413508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.414093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.414311] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.414434] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.414552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.414621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.414973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.414973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.415106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.415282] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8efad038-46d9-4629-9147-1741df5ffca3 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.415392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.415510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.415677] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.415821] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.415917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.415979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.416890] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.417101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.417283] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.417450] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8efad038-46d9-4629-9147-1741df5ffca3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.780636] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce998c5-dc06-41cd-af9e-8a9554ca2092 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.785024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.785024] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce998c5-dc06-41cd-af9e-8a9554ca2092',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.785024] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae with status ACTIVE [ 663.785024] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.785024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.785024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.785024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.785024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.785024] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.785024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.785024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.785024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.785024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.785024] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.785024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.785024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.789702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.789702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.789980] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae is going to be updated. [ 663.815737] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.816256] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.816615] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.816927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.817129] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.817330] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3a1ae6c-ae34-4142-b8f2-6d75ddae19ae" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.877569] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4754c815-e215-49af-b64e-e52ebe2b915e in Status: SUCCESS [ 663.877847] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4754c815-e215-49af-b64e-e52ebe2b915e deletion is rescheduled due to dependency. [ 663.877961] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.911538] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 in Status: SUCCESS [ 663.911538] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.920050] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8efad038-46d9-4629-9147-1741df5ffca3: rpc.has_security_group_logging(os_id): False [ 663.960175] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.960488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.960488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.960818] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.960952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.961199] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.961344] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.961407] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.961541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.962224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.962224] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.962224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.962959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.963228] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.963371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.963622] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.964012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.964012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.964012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.964189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.964189] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8efad038-46d9-4629-9147-1741df5ffca3 is going to be created. [ 664.088316] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.088316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.088316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.088316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.088316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.104571] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8efad038-46d9-4629-9147-1741df5ffca3 in Status: IN_PROGRESS for 2s [ 664.293307] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce998c5-dc06-41cd-af9e-8a9554ca2092',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.798587] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.799098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.799098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.799288] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.799444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.799610] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 is going to be created. [ 664.827623] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.827847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.827847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.828090] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.828262] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.842107] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 in Status: UNINITIALIZED for 2s [ 665.088835] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: SUCCESS [ 665.089063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.101988] env[69343]: INFO networking_nsxv3.common.synchronization [None req-ddc630a2-79a7-4575-a8e3-913dfb3bb621 None None] Enqueued Resource ID: 8c9e4e2d-b3af-4d4d-b819-7b6748d01303 with Priority: HIGHEST for action port [ 665.102812] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c9e4e2d-b3af-4d4d-b819-7b6748d01303 with Priority: HIGHEST for action port [ 665.106562] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c9e4e2d-b3af-4d4d-b819-7b6748d01303 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.106562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c9e4e2d-b3af-4d4d-b819-7b6748d01303" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.106562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c9e4e2d-b3af-4d4d-b819-7b6748d01303" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.106562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c9e4e2d-b3af-4d4d-b819-7b6748d01303" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.106562] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c9e4e2d-b3af-4d4d-b819-7b6748d01303',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.194306] env[69343]: INFO networking_nsxv3.common.synchronization [None req-8cfc9d94-b6b1-4670-8ccc-2c1616f266f9 None None] Enqueued Resource ID: 8272b2a3-f222-4fe2-b254-b5c78faea031 with Priority: HIGHEST for action port [ 665.194306] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8272b2a3-f222-4fe2-b254-b5c78faea031 with Priority: HIGHEST for action port [ 665.196370] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-8272b2a3-f222-4fe2-b254-b5c78faea031 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.198772] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8272b2a3-f222-4fe2-b254-b5c78faea031" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.198772] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8272b2a3-f222-4fe2-b254-b5c78faea031" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.198772] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8272b2a3-f222-4fe2-b254-b5c78faea031" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.198772] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8272b2a3-f222-4fe2-b254-b5c78faea031',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.296751] env[69343]: INFO networking_nsxv3.common.synchronization [req-a386e5ba-df55-48b5-8806-7d899f5fb9fa req-d52fd1f5-95a2-40d3-82a8-825badf14179 tempest-ServersTestMultiNic-93755808 tempest-ServersTestMultiNic-93755808-project-member] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 665.298144] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 665.298144] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.299199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.299284] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.300781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.301530] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.302651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.302651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.302651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.302651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.302651] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.607441] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c9e4e2d-b3af-4d4d-b819-7b6748d01303 [ 665.607763] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.608083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.608221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.608491] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.608638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.608759] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c9e4e2d-b3af-4d4d-b819-7b6748d01303 already deleted. [ 665.608842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c9e4e2d-b3af-4d4d-b819-7b6748d01303" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.705446] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8272b2a3-f222-4fe2-b254-b5c78faea031 [ 665.705446] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.705446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.705446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.705446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.705446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.705446] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8272b2a3-f222-4fe2-b254-b5c78faea031 already deleted. [ 665.705446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8272b2a3-f222-4fe2-b254-b5c78faea031" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.807460] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.807460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.807460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.807460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.807460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.807460] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.807460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.807460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.807460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.807460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.807460] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee already deleted. [ 665.807460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.122718] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8efad038-46d9-4629-9147-1741df5ffca3 in Status: SUCCESS [ 666.123719] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.542369] env[69343]: INFO networking_nsxv3.common.synchronization [req-a386e5ba-df55-48b5-8806-7d899f5fb9fa req-9783fcf3-fc98-4b91-8290-70dff586b91c tempest-ServersTestMultiNic-93755808 tempest-ServersTestMultiNic-93755808-project-member] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 666.542905] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 666.546021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.546021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.546021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.546021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.546021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.546021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.548058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.548058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.548058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.548058] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.853913] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 in Status: SUCCESS [ 666.856553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.856553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.856553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.856553] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.856553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.856553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.856553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.856553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.856553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.856553] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ce998c5-dc06-41cd-af9e-8a9554ca2092',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.053806] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.054165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.054165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.054321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.054377] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.054586] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.054684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.054744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.054893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.054966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.055536] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee already deleted. [ 667.055667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.319901] env[69343]: INFO networking_nsxv3.common.synchronization [req-f9f8e367-e4c1-439d-a474-796bf01713b0 req-caa73995-18c6-4c2a-9acd-08048ca2451d tempest-SecurityGroupRulesTestJSON-260969652 tempest-SecurityGroupRulesTestJSON-260969652-project-member] Enqueued Resource ID: e4bd4c24-f975-4a6f-ac64-1446bedef6d0 with Priority: HIGHEST for action security_group_rules [ 667.321092] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4bd4c24-f975-4a6f-ac64-1446bedef6d0 with Priority: HIGHEST for action security_group_rules [ 667.321321] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4bd4c24-f975-4a6f-ac64-1446bedef6d0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.321529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4bd4c24-f975-4a6f-ac64-1446bedef6d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.321529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4bd4c24-f975-4a6f-ac64-1446bedef6d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.321741] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4bd4c24-f975-4a6f-ac64-1446bedef6d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.321837] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4bd4c24-f975-4a6f-ac64-1446bedef6d0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.363984] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ce998c5-dc06-41cd-af9e-8a9554ca2092',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.372655] env[69343]: INFO networking_nsxv3.common.synchronization [req-a386e5ba-df55-48b5-8806-7d899f5fb9fa req-7eef0a31-ac22-4943-ab3a-ba4e7e1b3aa5 tempest-ServersTestMultiNic-93755808 tempest-ServersTestMultiNic-93755808-project-member] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 667.373664] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 667.374881] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.374881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.374881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.374881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.374881] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.374881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.374881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.376061] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.376061] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.376061] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.849352] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.849523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.849589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.849816] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.849904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.849998] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4bd4c24-f975-4a6f-ac64-1446bedef6d0 already deleted. [ 667.850087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4bd4c24-f975-4a6f-ac64-1446bedef6d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.867348] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ce998c5-dc06-41cd-af9e-8a9554ca2092: rpc.has_security_group_logging(os_id): False [ 667.879792] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.879910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.879910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.880279] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.880370] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.880577] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.881352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.881352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.881352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.881352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.881352] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee already deleted. [ 667.881352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.890440] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.890638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.890687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.890879] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.891011] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.891289] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.891454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.891521] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.891690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.891760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.891847] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 is going to be created. [ 667.970160] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.970160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.970160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.970160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.970160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.987802] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 in Status: IN_PROGRESS for 2s [ 668.212617] env[69343]: INFO networking_nsxv3.common.synchronization [None req-88cd86fb-3f62-4d81-9574-f1259a2075fe None None] Enqueued Resource ID: 9ced158c-02f9-4ad5-9a8c-f804d4eadc4e with Priority: HIGHEST for action port [ 668.212617] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ced158c-02f9-4ad5-9a8c-f804d4eadc4e with Priority: HIGHEST for action port [ 668.212617] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ced158c-02f9-4ad5-9a8c-f804d4eadc4e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.212617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ced158c-02f9-4ad5-9a8c-f804d4eadc4e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.212617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ced158c-02f9-4ad5-9a8c-f804d4eadc4e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.212617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ced158c-02f9-4ad5-9a8c-f804d4eadc4e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.212617] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ced158c-02f9-4ad5-9a8c-f804d4eadc4e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.435362] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-378 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.435732] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-378" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.435844] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-378" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.436121] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-378" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.436530] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.436632] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.436673] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.436953] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.441846] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.441846] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 668.441846] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.441846] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.441846] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.441846] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 668.441846] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.441846] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.465835] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.466726] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 668.466726] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.466726] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-378" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.467709] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-fb5b0a30-9185-4f0d-861c-f38a07f05392 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.467862] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-fb5b0a30-9185-4f0d-861c-f38a07f05392" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.467989] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-fb5b0a30-9185-4f0d-861c-f38a07f05392" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.468384] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-fb5b0a30-9185-4f0d-861c-f38a07f05392" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.469059] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb5b0a30-9185-4f0d-861c-f38a07f05392',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.480387] env[69343]: INFO networking_nsxv3.common.synchronization [None req-d69e608b-d068-4d83-afdc-1913f522c883 None None] Enqueued Resource ID: ab242085-1abf-4319-b618-43218797462e with Priority: HIGHEST for action port [ 668.480387] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab242085-1abf-4319-b618-43218797462e with Priority: HIGHEST for action port [ 668.480387] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab242085-1abf-4319-b618-43218797462e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.480387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab242085-1abf-4319-b618-43218797462e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.480387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab242085-1abf-4319-b618-43218797462e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.481378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab242085-1abf-4319-b618-43218797462e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.481674] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab242085-1abf-4319-b618-43218797462e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.715557] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ced158c-02f9-4ad5-9a8c-f804d4eadc4e [ 668.716262] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.716262] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.716262] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.716525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.716525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.716525] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ced158c-02f9-4ad5-9a8c-f804d4eadc4e already deleted. [ 668.716633] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ced158c-02f9-4ad5-9a8c-f804d4eadc4e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.972130] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.972469] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.972566] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.972867] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.973063] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.973194] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port fb5b0a30-9185-4f0d-861c-f38a07f05392 not found, creating... [ 668.973792] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.973792] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.973792] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.973995] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.974191] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.974482] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.974734] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.976343] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.976343] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.976536] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.976942] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: fb5b0a30-9185-4f0d-861c-f38a07f05392 is going to be created. [ 668.985435] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab242085-1abf-4319-b618-43218797462e [ 668.985742] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.985954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.986094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.986351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.986351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.986910] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab242085-1abf-4319-b618-43218797462e already deleted. [ 668.987040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab242085-1abf-4319-b618-43218797462e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.040468] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.040680] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.040798] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.041147] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.041479] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.041595] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-fb5b0a30-9185-4f0d-861c-f38a07f05392" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.010376] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 in Status: SUCCESS [ 670.010750] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.369887] env[69343]: INFO networking_nsxv3.common.synchronization [req-a386e5ba-df55-48b5-8806-7d899f5fb9fa req-845efe58-fc8b-4683-9cde-d98ae7bc04ad service nova] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_rules [ 670.370094] env[69343]: INFO networking_nsxv3.common.synchronization [req-a386e5ba-df55-48b5-8806-7d899f5fb9fa req-845efe58-fc8b-4683-9cde-d98ae7bc04ad service nova] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 670.370238] env[69343]: INFO networking_nsxv3.common.synchronization [req-a386e5ba-df55-48b5-8806-7d899f5fb9fa req-845efe58-fc8b-4683-9cde-d98ae7bc04ad service nova] Enqueued Resource ID: fb5b0a30-9185-4f0d-861c-f38a07f05392 with Priority: HIGHEST for action port [ 670.370870] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_rules [ 670.371497] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 670.371678] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb5b0a30-9185-4f0d-861c-f38a07f05392 with Priority: HIGHEST for action port [ 670.371982] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.372217] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.372312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.372670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.372806] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.378028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.378028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.378028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.378028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.378028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.378028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.378028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.378028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.378028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.378028] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.378028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb5b0a30-9185-4f0d-861c-f38a07f05392 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.378028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb5b0a30-9185-4f0d-861c-f38a07f05392" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.378028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb5b0a30-9185-4f0d-861c-f38a07f05392" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.378028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb5b0a30-9185-4f0d-861c-f38a07f05392" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.378028] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb5b0a30-9185-4f0d-861c-f38a07f05392',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.879748] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.879881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.880261] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.881391] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb5b0a30-9185-4f0d-861c-f38a07f05392 with status ACTIVE [ 670.882169] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.882169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.882169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.882373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.882373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.882695] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.882695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.882695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.882998] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.882998] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.883329] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.883329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.883329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.883477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.883509] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.883604] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb5b0a30-9185-4f0d-861c-f38a07f05392 is going to be updated. [ 670.910502] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.910502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.910502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.910502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.910502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.910502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb5b0a30-9185-4f0d-861c-f38a07f05392" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.275582] env[69343]: INFO networking_nsxv3.common.synchronization [None req-394528ff-fda6-46ee-9592-d00aacabacfb tempest-ServerActionsTestOtherB-1339566970 tempest-ServerActionsTestOtherB-1339566970-project-member] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_rules [ 671.276184] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_rules [ 671.276503] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.276632] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.276697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.278434] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.278544] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.386067] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.453907] env[69343]: INFO networking_nsxv3.common.synchronization [None req-9f95ed54-1722-4c57-91b2-df3ecad64d4c tempest-ServerActionsTestOtherB-1339566970 tempest-ServerActionsTestOtherB-1339566970-project-member] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_rules [ 671.454635] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_rules [ 671.456812] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.456996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.807198] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-889 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.807198] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-889" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.807198] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-889" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.807198] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-889" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.807198] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.807198] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.807198] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.807198] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.807797] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.807797] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.807917] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.808047] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.808186] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.808360] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.808547] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.808850] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.813996] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.814171] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.814246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.814486] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.814576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.814675] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 already deleted. [ 671.814757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.815343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.815547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.815645] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.845473] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.845649] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 671.846611] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.846611] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-889" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.846611] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-75c81e07-3c65-42dd-aae7-20dac567df71 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.846611] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-75c81e07-3c65-42dd-aae7-20dac567df71" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.846611] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-75c81e07-3c65-42dd-aae7-20dac567df71" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.846931] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-75c81e07-3c65-42dd-aae7-20dac567df71" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.847118] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75c81e07-3c65-42dd-aae7-20dac567df71',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.892274] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.893196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.893196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.893196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.893196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.893196] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be created. [ 671.922840] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.923050] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.923508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.923743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.923922] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.936100] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: UNINITIALIZED for 2s [ 672.340068] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.340068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.340068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.340068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.340068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.340068] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 already deleted. [ 672.340068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.353038] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.353038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.353038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.353038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.353038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.353038] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 75c81e07-3c65-42dd-aae7-20dac567df71 not found, creating... [ 672.353038] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.353038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.353038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.353038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.353038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.353981] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.354808] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.355859] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.356535] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.358628] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.358628] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 75c81e07-3c65-42dd-aae7-20dac567df71 is going to be created. [ 672.385117] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.385117] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.385117] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.385117] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.385117] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.385117] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-75c81e07-3c65-42dd-aae7-20dac567df71" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.951390] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: SUCCESS [ 673.951869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.951869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.952131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.952310] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.952505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.952505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.952742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.952742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.952906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.952906] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.966543] env[69343]: INFO networking_nsxv3.common.synchronization [req-a386e5ba-df55-48b5-8806-7d899f5fb9fa req-6ef2720c-fd75-45c4-9496-dcb6af65c0b6 service nova] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_rules [ 673.966756] env[69343]: INFO networking_nsxv3.common.synchronization [req-a386e5ba-df55-48b5-8806-7d899f5fb9fa req-6ef2720c-fd75-45c4-9496-dcb6af65c0b6 service nova] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 673.966876] env[69343]: INFO networking_nsxv3.common.synchronization [req-a386e5ba-df55-48b5-8806-7d899f5fb9fa req-6ef2720c-fd75-45c4-9496-dcb6af65c0b6 service nova] Enqueued Resource ID: 75c81e07-3c65-42dd-aae7-20dac567df71 with Priority: HIGHEST for action port [ 673.967800] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_rules [ 673.968088] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 673.968885] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c81e07-3c65-42dd-aae7-20dac567df71 with Priority: HIGHEST for action port [ 673.969593] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.969707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.969915] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.970039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.970105] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.970519] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.970678] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.970776] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.970836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.970998] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.971097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.971194] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.972429] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-75c81e07-3c65-42dd-aae7-20dac567df71 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.972671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75c81e07-3c65-42dd-aae7-20dac567df71" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.972742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75c81e07-3c65-42dd-aae7-20dac567df71" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.972913] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75c81e07-3c65-42dd-aae7-20dac567df71" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.973038] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75c81e07-3c65-42dd-aae7-20dac567df71',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.456329] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.457737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.474950] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.477782] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75c81e07-3c65-42dd-aae7-20dac567df71 with status ACTIVE [ 674.478019] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.478179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.478289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.478448] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.478577] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.478766] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.478896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.478953] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.479172] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.479273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.479441] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.479533] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.479596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.479730] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.482931] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.482931] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75c81e07-3c65-42dd-aae7-20dac567df71 is going to be updated. [ 674.505295] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.505540] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.505540] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.505776] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.505937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.506144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75c81e07-3c65-42dd-aae7-20dac567df71" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.982498] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.019668] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-378 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.020022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-378" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.020174] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-378" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.020792] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-378" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.021190] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.021591] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.021758] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.022219] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.022460] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.022727] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.022879] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.023036] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.023185] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.023331] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.024320] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.024320] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.046146] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.046414] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 675.046733] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.046940] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-378" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.047342] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.047772] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.047933] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.049229] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.049429] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.485520] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.485717] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.485795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.486064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.486246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.486303] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be updated. [ 675.526165] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.526358] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.526469] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.526847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.527080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.537541] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: IN_PROGRESS for 2s [ 675.552118] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.552373] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.552487] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.552760] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.553094] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.553286] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964 not found, creating... [ 675.553639] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.553879] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.554057] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.554447] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.554652] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.554909] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.555081] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.555201] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.555489] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.555594] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.555698] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964 is going to be created. [ 675.577379] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.577617] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.578282] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.578282] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.578282] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.578625] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.512599] env[69343]: INFO networking_nsxv3.common.synchronization [req-018ae22c-3f1d-45d9-8764-ff93e951d3f3 req-3d6a5a29-17e7-466c-8f56-4028d3596999 tempest-ServersWithSpecificFlavorTestJSON-666360316 tempest-ServersWithSpecificFlavorTestJSON-666360316-project-member] Enqueued Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_members [ 676.513126] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_members [ 676.513420] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3ee775-00c0-4c70-a79b-23338c04f67f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.513569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.513638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.513856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.514016] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.514425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.514499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.514653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.514738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.514831] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.017321] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.017512] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.017512] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.018180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.018180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.018180] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.018180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.018459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.019203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.019203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.019203] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f already deleted. [ 677.019203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.037998] env[69343]: INFO networking_nsxv3.common.synchronization [req-a386e5ba-df55-48b5-8806-7d899f5fb9fa req-c6ee0a3d-421d-4cbf-a3ba-73e8fb595d37 service nova] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_rules [ 677.038280] env[69343]: INFO networking_nsxv3.common.synchronization [req-a386e5ba-df55-48b5-8806-7d899f5fb9fa req-c6ee0a3d-421d-4cbf-a3ba-73e8fb595d37 service nova] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 677.038688] env[69343]: INFO networking_nsxv3.common.synchronization [req-a386e5ba-df55-48b5-8806-7d899f5fb9fa req-c6ee0a3d-421d-4cbf-a3ba-73e8fb595d37 service nova] Enqueued Resource ID: 88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964 with Priority: HIGHEST for action port [ 677.039794] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_rules [ 677.039794] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 677.039928] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964 with Priority: HIGHEST for action port [ 677.041980] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.043696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.043696] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.043696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.043696] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.043696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.043696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.043696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.043696] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.547473] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964 with status ACTIVE [ 677.547833] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.547905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.548164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.548271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.548313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.548489] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.548564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.548624] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.548776] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.548873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.549066] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.549246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.549368] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.549548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.549746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.549746] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964 is going to be updated. [ 677.554800] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: SUCCESS [ 677.554986] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.556492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.556492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.556703] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.556777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.556867] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.556985] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.557075] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.557157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.557361] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.557452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.557495] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.557632] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.557760] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.557889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.557935] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.558160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.558268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.558349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.558431] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.561165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.561165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.561165] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.561165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.561165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.561165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.561165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.561165] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.575395] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.575395] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-582" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.575395] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-582" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.575531] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-582" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.575947] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.576179] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.578422] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.578422] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.578422] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.578422] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 677.578422] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 677.578422] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 677.578422] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 677.578422] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 677.578422] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 677.578422] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 677.586554] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.586702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.586770] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.587247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.587298] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.587439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88a6cd23-d9ce-4e0e-aaef-d4bccd1cc964" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.612053] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 677.612303] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 677.612420] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 677.612616] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-582" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.612959] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.613163] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.613303] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.613650] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.613798] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.964913] env[69343]: INFO networking_nsxv3.common.synchronization [None req-01597189-47a3-440f-967c-1912831a7ab1 None None] Enqueued Resource ID: 3b948747-2a27-4119-b6b8-add4e049b350 with Priority: HIGHEST for action port [ 677.965717] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b948747-2a27-4119-b6b8-add4e049b350 with Priority: HIGHEST for action port [ 677.968054] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b948747-2a27-4119-b6b8-add4e049b350 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.968054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b948747-2a27-4119-b6b8-add4e049b350" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.968054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b948747-2a27-4119-b6b8-add4e049b350" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.968054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b948747-2a27-4119-b6b8-add4e049b350" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.968054] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b948747-2a27-4119-b6b8-add4e049b350',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.064873] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77342b3e-c1bc-49a4-9f26-15de2bffefee: rpc.has_security_group_logging(os_id): False [ 678.068152] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.089465] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.089614] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.089691] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.090060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.090060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.090275] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.090369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.090418] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.090568] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.090650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.090943] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.090943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.091096] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.091139] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.091182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.091366] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.091473] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.091542] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.091836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.091836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.091836] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be created. [ 678.118858] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.119670] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.119670] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.119786] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.120062] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.120435] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e not found, creating... [ 678.120639] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.120911] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.121054] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.121463] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.121665] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.121948] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.122260] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.122475] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.122691] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.122861] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.123058] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e is going to be created. [ 678.152267] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.152500] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.152627] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.152957] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.153570] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.153570] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.192398] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.193400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.193400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.193784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.194830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.207643] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: IN_PROGRESS for 2s [ 678.472761] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b948747-2a27-4119-b6b8-add4e049b350 [ 678.472761] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.472761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.472761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.472761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.472761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.472761] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b948747-2a27-4119-b6b8-add4e049b350 already deleted. [ 678.472761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b948747-2a27-4119-b6b8-add4e049b350" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.571751] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.080295] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.080295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.080295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.080295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.080295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.080295] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be updated. [ 679.119337] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.119964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.120285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.120466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.120632] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.134718] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: IN_PROGRESS for 2s [ 679.723028] env[69343]: INFO networking_nsxv3.common.synchronization [req-f6d8ead9-17c7-4c17-84eb-87f71a8e1d43 req-e73e6702-3192-429e-889e-960e8160204b tempest-TenantUsagesTestJSON-923809993 tempest-TenantUsagesTestJSON-923809993-project-member] Enqueued Resource ID: a262f752-6979-47b1-b3be-fd7926447348 with Priority: HIGHEST for action security_group_members [ 679.723028] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a262f752-6979-47b1-b3be-fd7926447348 with Priority: HIGHEST for action security_group_members [ 679.725222] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a262f752-6979-47b1-b3be-fd7926447348 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.725222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.725222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.725222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.725222] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.725826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.725826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.725826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.725826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.725826] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a262f752-6979-47b1-b3be-fd7926447348',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.092056] env[69343]: INFO networking_nsxv3.common.synchronization [None req-ebf3fc86-14d2-4f0b-8f17-84c44b38107b None None] Enqueued Resource ID: 60eb929b-a9df-4b3f-b7e4-772fea3fb36b with Priority: HIGHEST for action port [ 680.092056] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60eb929b-a9df-4b3f-b7e4-772fea3fb36b with Priority: HIGHEST for action port [ 680.092056] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-60eb929b-a9df-4b3f-b7e4-772fea3fb36b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.092788] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60eb929b-a9df-4b3f-b7e4-772fea3fb36b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.092788] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60eb929b-a9df-4b3f-b7e4-772fea3fb36b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.093166] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60eb929b-a9df-4b3f-b7e4-772fea3fb36b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.093296] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60eb929b-a9df-4b3f-b7e4-772fea3fb36b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.112035] env[69343]: INFO networking_nsxv3.common.synchronization [req-018ae22c-3f1d-45d9-8764-ff93e951d3f3 req-dc9bc975-71ad-41b0-ae01-72f93f2253df service nova] Enqueued Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_rules [ 680.112238] env[69343]: INFO networking_nsxv3.common.synchronization [req-018ae22c-3f1d-45d9-8764-ff93e951d3f3 req-dc9bc975-71ad-41b0-ae01-72f93f2253df service nova] Enqueued Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_members [ 680.112480] env[69343]: INFO networking_nsxv3.common.synchronization [req-018ae22c-3f1d-45d9-8764-ff93e951d3f3 req-dc9bc975-71ad-41b0-ae01-72f93f2253df service nova] Enqueued Resource ID: ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e with Priority: HIGHEST for action port [ 680.117755] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_rules [ 680.118060] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_members [ 680.118265] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e with Priority: HIGHEST for action port [ 680.118746] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f3ee775-00c0-4c70-a79b-23338c04f67f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.118952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.121062] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.121062] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.121062] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.124372] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3ee775-00c0-4c70-a79b-23338c04f67f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.125336] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.125944] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.127454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.128808] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.128808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.128808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.128808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.128808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.128808] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.136665] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.136665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.136665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.136665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.136665] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.227914] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: SUCCESS [ 680.228110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.228730] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.228992] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.229147] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.230470] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.230604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.230646] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.230840] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.230934] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.231179] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.231313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.231408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.231668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.231752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.231821] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a262f752-6979-47b1-b3be-fd7926447348 already deleted. [ 680.231904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.600487] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60eb929b-a9df-4b3f-b7e4-772fea3fb36b [ 680.600730] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.601549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.601549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.601549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.601549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.601549] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60eb929b-a9df-4b3f-b7e4-772fea3fb36b already deleted. [ 680.601549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60eb929b-a9df-4b3f-b7e4-772fea3fb36b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.641013] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.641013] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.641013] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.641013] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.641013] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.641013] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.641013] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.643060] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.643060] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.643060] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.643060] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.643060] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.643449] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.643449] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.643561] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.643669] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.645913] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e with status ACTIVE [ 680.646155] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.646312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.646921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.646921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.646921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.646921] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.647440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.647440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.648552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.648552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.648628] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.648758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.648867] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.649116] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.649250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.649397] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e is going to be updated. [ 680.651406] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3ee775-00c0-4c70-a79b-23338c04f67f taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.651406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.651406] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.681084] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.681084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.681084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.681084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.681084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.681084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee5cf5a6-c662-41f3-bc9d-e10f08a32c1e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.681084] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.681084] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 680.681084] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.681084] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.683245] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-7de7ed69-e095-4c4f-bfce-47a50727bd80 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.683495] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-7de7ed69-e095-4c4f-bfce-47a50727bd80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.683783] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-7de7ed69-e095-4c4f-bfce-47a50727bd80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.684040] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-7de7ed69-e095-4c4f-bfce-47a50727bd80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.684231] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7de7ed69-e095-4c4f-bfce-47a50727bd80',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.733355] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.736384] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.007549] env[69343]: INFO networking_nsxv3.common.synchronization [req-b9a37d71-1a88-447a-829f-67394fb8d0cf req-442d1a6e-50b3-43a0-abd6-fc842c586c80 tempest-ImagesOneServerTestJSON-56318304 tempest-ImagesOneServerTestJSON-56318304-project-member] Enqueued Resource ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee with Priority: HIGHEST for action security_group_members [ 681.008336] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee with Priority: HIGHEST for action security_group_members [ 681.008811] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.010070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.010070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.010070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.010070] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.010070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.010070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.012444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.012444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.012444] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8724753-bf27-4f9c-95b9-1ddfd48e01ee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.148887] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: SUCCESS [ 681.150860] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.151072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.151318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.151574] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.151703] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.151762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.151934] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.152052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.152118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.152220] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.153264] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.189051] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.189051] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.189051] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.189051] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.189051] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.189051] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 7de7ed69-e095-4c4f-bfce-47a50727bd80 not found, creating... [ 681.189051] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.189051] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.189051] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.190498] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.190498] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.190498] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.192387] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.192622] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.192980] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.193255] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.193574] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 7de7ed69-e095-4c4f-bfce-47a50727bd80 is going to be created. [ 681.217844] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.221886] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.221886] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.221886] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.221886] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.221886] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-7de7ed69-e095-4c4f-bfce-47a50727bd80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.514824] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.514987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.515198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.515456] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.515559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.515782] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.515914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.515971] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.516115] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.516192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.517473] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee already deleted. [ 681.517473] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.657966] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.658267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.658267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.658428] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.658524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.658625] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f is going to be created. [ 681.660107] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.660352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.660352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.660595] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.660813] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.660935] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.660995] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.661745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.661857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.661916] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.662095] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.662193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.662260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.662569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.662569] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.662756] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.662756] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.662830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.662910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.663149] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.663149] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.696645] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-310 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.696913] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-310" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.696978] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-310" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.697454] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-310" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.697748] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.697901] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.698032] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.698278] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.698459] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.698680] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.698796] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.698909] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.699020] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.699122] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.699380] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.699556] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.705747] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.705747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.706023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.706023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.706156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.725427] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f in Status: UNINITIALIZED for 2s [ 681.727008] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.727232] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 681.727395] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.727584] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-310" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.727918] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-8079b7ef-1181-46e0-ae96-f3d7c8a96079 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.728091] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-8079b7ef-1181-46e0-ae96-f3d7c8a96079" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.728213] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-8079b7ef-1181-46e0-ae96-f3d7c8a96079" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.728546] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-8079b7ef-1181-46e0-ae96-f3d7c8a96079" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.728722] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8079b7ef-1181-46e0-ae96-f3d7c8a96079',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.165293] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77342b3e-c1bc-49a4-9f26-15de2bffefee: rpc.has_security_group_logging(os_id): False [ 682.186144] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.186144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.186144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.186415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.186455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.186655] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.186761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.186827] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.186991] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.187087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.187451] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.187451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.187631] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.187701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.187780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.188164] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.188326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.188388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.188553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.188699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.188744] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be updated. [ 682.231621] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.231864] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.231992] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.232306] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.232649] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.232874] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 8079b7ef-1181-46e0-ae96-f3d7c8a96079 not found, creating... [ 682.233177] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.233345] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.233469] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.233714] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.233857] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.234180] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.234341] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.234462] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.234686] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.234821] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.236190] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 8079b7ef-1181-46e0-ae96-f3d7c8a96079 is going to be created. [ 682.259809] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.260085] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.260200] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.260490] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.260734] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.260988] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-8079b7ef-1181-46e0-ae96-f3d7c8a96079" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.263492] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.263647] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.263694] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.263862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.263994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.279872] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: IN_PROGRESS for 2s [ 682.545157] env[69343]: INFO networking_nsxv3.common.synchronization [req-f6d8ead9-17c7-4c17-84eb-87f71a8e1d43 req-aed9945e-3243-45bd-aa2d-7747785ef85e service nova] Enqueued Resource ID: a262f752-6979-47b1-b3be-fd7926447348 with Priority: HIGHEST for action security_group_rules [ 682.545472] env[69343]: INFO networking_nsxv3.common.synchronization [req-f6d8ead9-17c7-4c17-84eb-87f71a8e1d43 req-aed9945e-3243-45bd-aa2d-7747785ef85e service nova] Enqueued Resource ID: a262f752-6979-47b1-b3be-fd7926447348 with Priority: HIGHEST for action security_group_members [ 682.545708] env[69343]: INFO networking_nsxv3.common.synchronization [req-f6d8ead9-17c7-4c17-84eb-87f71a8e1d43 req-aed9945e-3243-45bd-aa2d-7747785ef85e service nova] Enqueued Resource ID: 7de7ed69-e095-4c4f-bfce-47a50727bd80 with Priority: HIGHEST for action port [ 682.546728] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a262f752-6979-47b1-b3be-fd7926447348 with Priority: HIGHEST for action security_group_rules [ 682.546924] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a262f752-6979-47b1-b3be-fd7926447348 with Priority: HIGHEST for action security_group_members [ 682.547087] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7de7ed69-e095-4c4f-bfce-47a50727bd80 with Priority: HIGHEST for action port [ 682.547498] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a262f752-6979-47b1-b3be-fd7926447348 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.547989] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.547989] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.548134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.548411] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a262f752-6979-47b1-b3be-fd7926447348',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.549416] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a262f752-6979-47b1-b3be-fd7926447348 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.550143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.550143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.550143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.550367] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.550495] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.550699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.550773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.550825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.550923] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a262f752-6979-47b1-b3be-fd7926447348',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.552219] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-7de7ed69-e095-4c4f-bfce-47a50727bd80 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.552793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7de7ed69-e095-4c4f-bfce-47a50727bd80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.552884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7de7ed69-e095-4c4f-bfce-47a50727bd80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.553079] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7de7ed69-e095-4c4f-bfce-47a50727bd80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.553160] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7de7ed69-e095-4c4f-bfce-47a50727bd80',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.925110] env[69343]: INFO networking_nsxv3.common.synchronization [req-fd7bf028-7e85-47f2-93b5-138d4c4dca06 req-c1f435d7-ad96-4b7a-a79d-dac3849a046b tempest-InstanceActionsNegativeTestJSON-1465423023 tempest-InstanceActionsNegativeTestJSON-1465423023-project-member] Enqueued Resource ID: 8efad038-46d9-4629-9147-1741df5ffca3 with Priority: HIGHEST for action security_group_members [ 682.925706] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8efad038-46d9-4629-9147-1741df5ffca3 with Priority: HIGHEST for action security_group_members [ 682.926596] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8efad038-46d9-4629-9147-1741df5ffca3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.926596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.930854] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.930854] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.930854] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.930854] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.930854] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.930854] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.930854] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.930854] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8efad038-46d9-4629-9147-1741df5ffca3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.056069] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a262f752-6979-47b1-b3be-fd7926447348',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.056718] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a262f752-6979-47b1-b3be-fd7926447348 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.056823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.057356] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7de7ed69-e095-4c4f-bfce-47a50727bd80 with status ACTIVE [ 683.057356] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.057356] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.057356] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.057802] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.057802] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.057802] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.057965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.057965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.060083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.060083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.060083] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.060083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.060083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.060083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.060083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.060672] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7de7ed69-e095-4c4f-bfce-47a50727bd80 is going to be updated. [ 683.106017] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.106017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.106017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.106017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.106017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.106017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7de7ed69-e095-4c4f-bfce-47a50727bd80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.438823] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.438823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.438823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.438823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.438823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.438823] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.438823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.438823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.438823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.438823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.438823] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8efad038-46d9-4629-9147-1741df5ffca3 is going to be updated. [ 683.474506] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.474673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.474737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.474993] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.475159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.492805] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8efad038-46d9-4629-9147-1741df5ffca3 in Status: IN_PROGRESS for 2s [ 683.557810] env[69343]: INFO networking_nsxv3.common.synchronization [None req-af0acb32-63e9-464f-8386-852ec2c82f38 None None] Enqueued Resource ID: 3ab973fe-978c-45a9-bc61-17c2370ad18e with Priority: HIGHEST for action port [ 683.558108] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ab973fe-978c-45a9-bc61-17c2370ad18e with Priority: HIGHEST for action port [ 683.558578] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ab973fe-978c-45a9-bc61-17c2370ad18e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.558712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ab973fe-978c-45a9-bc61-17c2370ad18e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.558780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ab973fe-978c-45a9-bc61-17c2370ad18e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.559218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ab973fe-978c-45a9-bc61-17c2370ad18e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.559218] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ab973fe-978c-45a9-bc61-17c2370ad18e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.569469] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a262f752-6979-47b1-b3be-fd7926447348',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.739033] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f in Status: SUCCESS [ 683.739033] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.739381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.739472] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.739685] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.739810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.739876] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.740071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.740162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.740328] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.740433] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.828310] env[69343]: INFO networking_nsxv3.common.synchronization [req-b9a37d71-1a88-447a-829f-67394fb8d0cf req-15b9e49e-0e35-4cc4-b8fd-3d20bc357a33 service nova] Enqueued Resource ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee with Priority: HIGHEST for action security_group_rules [ 683.828703] env[69343]: INFO networking_nsxv3.common.synchronization [req-b9a37d71-1a88-447a-829f-67394fb8d0cf req-15b9e49e-0e35-4cc4-b8fd-3d20bc357a33 service nova] Enqueued Resource ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee with Priority: HIGHEST for action security_group_members [ 683.828901] env[69343]: INFO networking_nsxv3.common.synchronization [req-b9a37d71-1a88-447a-829f-67394fb8d0cf req-15b9e49e-0e35-4cc4-b8fd-3d20bc357a33 service nova] Enqueued Resource ID: 8079b7ef-1181-46e0-ae96-f3d7c8a96079 with Priority: HIGHEST for action port [ 683.829474] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee with Priority: HIGHEST for action security_group_rules [ 683.831206] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee with Priority: HIGHEST for action security_group_members [ 683.831334] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8079b7ef-1181-46e0-ae96-f3d7c8a96079 with Priority: HIGHEST for action port [ 683.831618] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8724753-bf27-4f9c-95b9-1ddfd48e01ee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.831749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.831817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.832178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.832270] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8724753-bf27-4f9c-95b9-1ddfd48e01ee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.833141] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.833347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.833347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.833500] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.833647] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.833743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.833806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.833947] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.834041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.837092] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8724753-bf27-4f9c-95b9-1ddfd48e01ee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.840387] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-8079b7ef-1181-46e0-ae96-f3d7c8a96079 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.840824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8079b7ef-1181-46e0-ae96-f3d7c8a96079" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.841263] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8079b7ef-1181-46e0-ae96-f3d7c8a96079" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.841482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8079b7ef-1181-46e0-ae96-f3d7c8a96079" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.842357] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8079b7ef-1181-46e0-ae96-f3d7c8a96079',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.063245] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ab973fe-978c-45a9-bc61-17c2370ad18e [ 684.063464] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.063766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.063850] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.064090] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.064184] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.064322] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ab973fe-978c-45a9-bc61-17c2370ad18e already deleted. [ 684.064415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ab973fe-978c-45a9-bc61-17c2370ad18e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.072023] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.072354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.072635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.072894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.073027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.073156] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a262f752-6979-47b1-b3be-fd7926447348 is going to be created. [ 684.097412] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.097576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.097644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.097860] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.098041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.109448] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a262f752-6979-47b1-b3be-fd7926447348 in Status: UNINITIALIZED for 2s [ 684.242749] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.296690] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: SUCCESS [ 684.300763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.300763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.300763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.300763] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.345488] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.346180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.346425] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a8724753-bf27-4f9c-95b9-1ddfd48e01ee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.347560] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8079b7ef-1181-46e0-ae96-f3d7c8a96079 with status ACTIVE [ 684.347621] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.348391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.348391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.348391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.348391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.348391] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.348391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.348391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.348720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.348720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.349996] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.350592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.350910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.351098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.351479] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.351479] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8079b7ef-1181-46e0-ae96-f3d7c8a96079 is going to be updated. [ 684.377436] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.377839] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.379037] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.379037] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.379037] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.379037] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8079b7ef-1181-46e0-ae96-f3d7c8a96079" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.746835] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f3ee775-00c0-4c70-a79b-23338c04f67f: rpc.has_security_group_logging(os_id): False [ 684.766330] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.766569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.766569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.766790] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.766942] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.767841] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.767841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.767841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.767841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.767841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.767841] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f is going to be created. [ 684.804518] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.804699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.804756] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.805017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.806306] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.806306] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.806306] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.806306] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.806306] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.806306] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.806306] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.838739] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.838739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.838739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.838739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.838739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.851309] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f in Status: IN_PROGRESS for 2s [ 684.855391] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a8724753-bf27-4f9c-95b9-1ddfd48e01ee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.309308] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.310376] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.313022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.313022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.313022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.313022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.313022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.313022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.313022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.313022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.313022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.313022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.313022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.313022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.313022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.313022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.313022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.313022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.313022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.313022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.313847] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.363050] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.363416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.363820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.364104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.364257] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.364375] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee is going to be created. [ 685.398920] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.399135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.399206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.399517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.399742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.411276] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee in Status: UNINITIALIZED for 2s [ 685.487097] env[69343]: INFO networking_nsxv3.common.synchronization [None req-6eb267ad-0166-4aa0-b469-ab4e972d3c41 None None] Enqueued Resource ID: 94d614d3-7ded-4cf8-8fe0-d9569ca3e58b with Priority: HIGHEST for action port [ 685.487693] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94d614d3-7ded-4cf8-8fe0-d9569ca3e58b with Priority: HIGHEST for action port [ 685.490567] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-94d614d3-7ded-4cf8-8fe0-d9569ca3e58b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.490567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94d614d3-7ded-4cf8-8fe0-d9569ca3e58b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.490567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94d614d3-7ded-4cf8-8fe0-d9569ca3e58b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.491236] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94d614d3-7ded-4cf8-8fe0-d9569ca3e58b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.491236] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94d614d3-7ded-4cf8-8fe0-d9569ca3e58b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.506691] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8efad038-46d9-4629-9147-1741df5ffca3 in Status: SUCCESS [ 685.506691] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8efad038-46d9-4629-9147-1741df5ffca3 deletion is rescheduled due to dependency. [ 685.506842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.817571] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77342b3e-c1bc-49a4-9f26-15de2bffefee: rpc.has_security_group_logging(os_id): False [ 685.837167] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.837372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.837519] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.837705] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.837792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.839013] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.839013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.839013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.839013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.839013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.839347] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.839347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.839433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.839516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.839618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.839852] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.840089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.840089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.840473] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.840606] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.840650] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be updated. [ 685.921293] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.921393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.921497] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.921792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.922029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.936734] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: IN_PROGRESS for 2s [ 685.994224] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94d614d3-7ded-4cf8-8fe0-d9569ca3e58b [ 685.994487] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.994686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.996112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.996112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.996112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.996112] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94d614d3-7ded-4cf8-8fe0-d9569ca3e58b already deleted. [ 685.996112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94d614d3-7ded-4cf8-8fe0-d9569ca3e58b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.099792] env[69343]: INFO networking_nsxv3.common.synchronization [None req-c236b13a-af39-492d-b16d-0bba5e3baa03 None None] Enqueued Resource ID: af8d832b-1655-4426-a5bf-887b58502ab3 with Priority: HIGHEST for action port [ 686.100998] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af8d832b-1655-4426-a5bf-887b58502ab3 with Priority: HIGHEST for action port [ 686.100998] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-af8d832b-1655-4426-a5bf-887b58502ab3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.100998] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af8d832b-1655-4426-a5bf-887b58502ab3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.100998] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af8d832b-1655-4426-a5bf-887b58502ab3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.103494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af8d832b-1655-4426-a5bf-887b58502ab3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.103613] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af8d832b-1655-4426-a5bf-887b58502ab3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.120450] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a262f752-6979-47b1-b3be-fd7926447348 in Status: SUCCESS [ 686.120450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.120548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.120750] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.120937] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.121100] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.121171] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.121364] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.121441] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.121499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.124220] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a262f752-6979-47b1-b3be-fd7926447348',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.606520] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af8d832b-1655-4426-a5bf-887b58502ab3 [ 686.606808] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.606808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.606973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.607532] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.607653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.607739] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af8d832b-1655-4426-a5bf-887b58502ab3 already deleted. [ 686.607821] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af8d832b-1655-4426-a5bf-887b58502ab3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.624081] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a262f752-6979-47b1-b3be-fd7926447348 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.624228] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.624472] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.624472] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.624669] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.624953] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.624953] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.625087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.625123] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.625221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.625358] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a262f752-6979-47b1-b3be-fd7926447348 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.625493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.625554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.625687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.625827] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.625940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.626021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.626128] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.626204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.626371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.626371] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a262f752-6979-47b1-b3be-fd7926447348',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.870968] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f in Status: SUCCESS [ 686.871419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.130763] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a262f752-6979-47b1-b3be-fd7926447348: rpc.has_security_group_logging(os_id): False [ 687.171427] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.171887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.172904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.172904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.172904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.173584] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.175683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.175683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.175683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.175683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.175683] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.175683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.175683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.175683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.175683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.176475] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.176768] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.176964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.177268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.177511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.179286] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a262f752-6979-47b1-b3be-fd7926447348 is going to be created. [ 687.242864] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.243087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.243169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.243427] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.243736] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.256898] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a262f752-6979-47b1-b3be-fd7926447348 in Status: IN_PROGRESS for 2s [ 687.427439] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee in Status: SUCCESS [ 687.427439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.427439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.427439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.427439] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.427439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.427439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.427439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.427439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.427439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.427439] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a8724753-bf27-4f9c-95b9-1ddfd48e01ee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.930847] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.930847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.930847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.930847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.930847] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.930847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.930847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.934030] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.934030] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.934030] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.935305] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.935305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.935305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.935474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.935600] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.937046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.937046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.938038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.938038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.938038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.938038] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a8724753-bf27-4f9c-95b9-1ddfd48e01ee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.961216] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: SUCCESS [ 687.961380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.140522] env[69343]: INFO networking_nsxv3.common.synchronization [req-b1209e00-7ff9-4c7c-9c73-5fb3d08e3875 req-c4f055bf-62de-4b78-a121-74657eadb328 tempest-ImagesTestJSON-628353040 tempest-ImagesTestJSON-628353040-project-member] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 688.141054] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 688.144789] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.144789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.144789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.144789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.144789] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.144789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.144789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.144789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.144789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.144789] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.445609] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a8724753-bf27-4f9c-95b9-1ddfd48e01ee: rpc.has_security_group_logging(os_id): False [ 688.466873] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.467106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.467106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.467358] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.467560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.467756] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.467854] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.467958] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.468109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.468229] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.468402] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.468511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.468559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.468761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.468818] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.469444] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.469444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.469444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.469444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.469444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.470533] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee is going to be created. [ 688.533758] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.534483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.534483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.534483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.534687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.547676] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee in Status: IN_PROGRESS for 2s [ 688.648175] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.648447] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.649141] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.649632] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.650141] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.650141] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.650141] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.650355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.650355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.650431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.650508] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 688.688296] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.688296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.688296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.689140] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.689140] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.703856] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 688.738321] env[69343]: INFO networking_nsxv3.common.synchronization [None req-6beb08c9-3b5b-4205-8912-ee804617fe47 None None] Enqueued Resource ID: 4dd222ff-4ffa-4dda-9540-6c0f85e1c62d with Priority: HIGHEST for action port [ 688.738321] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd222ff-4ffa-4dda-9540-6c0f85e1c62d with Priority: HIGHEST for action port [ 688.738321] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-4dd222ff-4ffa-4dda-9540-6c0f85e1c62d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.738321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4dd222ff-4ffa-4dda-9540-6c0f85e1c62d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.738915] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4dd222ff-4ffa-4dda-9540-6c0f85e1c62d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.739294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4dd222ff-4ffa-4dda-9540-6c0f85e1c62d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.739527] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dd222ff-4ffa-4dda-9540-6c0f85e1c62d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.243087] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4dd222ff-4ffa-4dda-9540-6c0f85e1c62d [ 689.243087] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.243087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.243087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.243087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.243087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.243087] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4dd222ff-4ffa-4dda-9540-6c0f85e1c62d already deleted. [ 689.243087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4dd222ff-4ffa-4dda-9540-6c0f85e1c62d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.270094] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a262f752-6979-47b1-b3be-fd7926447348 in Status: SUCCESS [ 689.270094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.438485] env[69343]: INFO networking_nsxv3.common.synchronization [None req-a2e1e33f-3626-4480-a2e9-2e9b46ce6fc0 None None] Enqueued Resource ID: b4df15fd-d82a-4d22-a0c2-26f1cc90ebe3 with Priority: HIGHEST for action port [ 690.438485] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4df15fd-d82a-4d22-a0c2-26f1cc90ebe3 with Priority: HIGHEST for action port [ 690.438485] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4df15fd-d82a-4d22-a0c2-26f1cc90ebe3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.440851] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4df15fd-d82a-4d22-a0c2-26f1cc90ebe3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.442047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4df15fd-d82a-4d22-a0c2-26f1cc90ebe3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.442047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4df15fd-d82a-4d22-a0c2-26f1cc90ebe3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.442047] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4df15fd-d82a-4d22-a0c2-26f1cc90ebe3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.565094] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee in Status: SUCCESS [ 690.565339] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.716397] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 690.716660] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b deletion is rescheduled due to dependency. [ 690.717158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.796423] env[69343]: INFO networking_nsxv3.common.synchronization [req-45426265-59c2-4a9d-9681-5060e9974bf4 req-9044c060-aa4f-42ee-a74f-b98486d18eb3 tempest-MultipleCreateTestJSON-1171017912 tempest-MultipleCreateTestJSON-1171017912-project-member] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 690.797030] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 690.797357] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.797510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.797582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.798110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.798325] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.798444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.798528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.798782] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.798874] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.798971] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.946570] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4df15fd-d82a-4d22-a0c2-26f1cc90ebe3 [ 690.946570] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.946570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.946570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.946570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.946570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.946570] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4df15fd-d82a-4d22-a0c2-26f1cc90ebe3 already deleted. [ 690.946570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4df15fd-d82a-4d22-a0c2-26f1cc90ebe3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.100795] env[69343]: INFO networking_nsxv3.common.synchronization [None req-836b4018-5a4b-4efc-b4f7-f2df5c37146f tempest-ServersTestManualDisk-1820487143 tempest-ServersTestManualDisk-1820487143-project-member] Enqueued Resource ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 with Priority: HIGHEST for action security_group_rules [ 691.103689] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 with Priority: HIGHEST for action security_group_rules [ 691.103689] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.103689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.103689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.103689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.103689] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44259464-12d7-4ca0-9bd3-7620c5aac9c5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.230189] env[69343]: INFO networking_nsxv3.common.synchronization [None req-e6f44448-8d94-4654-85ba-e03fa10023e4 tempest-ServersTestManualDisk-1820487143 tempest-ServersTestManualDisk-1820487143-project-member] Enqueued Resource ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 with Priority: HIGHEST for action security_group_rules [ 691.231309] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 with Priority: HIGHEST for action security_group_rules [ 691.231309] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.231309] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.302585] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.302753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.302753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.302753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.302753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.302753] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.302753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.302753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.302753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.302753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.302753] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 already deleted. [ 691.302753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.623934] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.624304] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.624304] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.624382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.624470] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.624640] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 already deleted. [ 691.624640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.624800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.624960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.625068] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44259464-12d7-4ca0-9bd3-7620c5aac9c5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.152245] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-254 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.152245] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-254" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.152245] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-254" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.152674] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-254" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.153251] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.153753] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.154616] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.155146] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.155512] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.156043] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.156310] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.156544] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.159023] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.159023] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.159023] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.159023] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.164753] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.165733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.165733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.167289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.167289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.167289] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 already deleted. [ 692.167289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.198549] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.198907] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 692.199128] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.199958] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-254" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.199958] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-bd1240b2-796c-4379-8aa6-cf2a00639048 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.200553] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-bd1240b2-796c-4379-8aa6-cf2a00639048" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.200747] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-bd1240b2-796c-4379-8aa6-cf2a00639048" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.201114] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-bd1240b2-796c-4379-8aa6-cf2a00639048" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.201333] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd1240b2-796c-4379-8aa6-cf2a00639048',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.709588] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.709588] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.709588] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.709588] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.709588] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.709588] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port bd1240b2-796c-4379-8aa6-cf2a00639048 not found, creating... [ 692.709588] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.709588] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.709588] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.709588] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.709588] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.710407] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.710407] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.710407] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.710407] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.710407] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.710407] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: bd1240b2-796c-4379-8aa6-cf2a00639048 is going to be created. [ 692.733232] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.733452] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.733581] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.734123] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.734274] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.734437] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-bd1240b2-796c-4379-8aa6-cf2a00639048" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.081208] env[69343]: INFO networking_nsxv3.common.synchronization [None req-a0776af4-7b41-4e56-bade-56d766a2ce03 tempest-ServerActionsTestOtherA-678333832 tempest-ServerActionsTestOtherA-678333832-project-member] Enqueued Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_rules [ 693.081821] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_rules [ 693.083210] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.086310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.086310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.086310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.086310] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.178936] env[69343]: INFO networking_nsxv3.common.synchronization [req-45426265-59c2-4a9d-9681-5060e9974bf4 req-7ced2dd3-2bf2-4ce0-9f87-dede419e1f70 tempest-MultipleCreateTestJSON-1171017912 tempest-MultipleCreateTestJSON-1171017912-project-member] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 693.180583] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 693.180583] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.180824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.180871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.181059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.181224] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.181326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.181388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.181560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.181760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.181840] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.289724] env[69343]: INFO networking_nsxv3.common.synchronization [None req-fdd7e0d9-8355-4ab8-bd9c-4fa43ef35821 tempest-ServerActionsTestOtherA-678333832 tempest-ServerActionsTestOtherA-678333832-project-member] Enqueued Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_rules [ 693.289724] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_rules [ 693.289724] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.289724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.609482] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.609482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.609626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.610130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.610130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.610130] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc already deleted. [ 693.610130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.610745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.610745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.610745] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.684392] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.684548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.686018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.686018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.686018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.686018] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.686018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.686018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.686018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.686018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.686018] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 already deleted. [ 693.686018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.748900] env[69343]: INFO networking_nsxv3.common.synchronization [None req-a3cfc04c-7a00-4019-b81b-2be238cdb9ff None None] Enqueued Resource ID: cc1c51b9-e499-48dd-8af9-92c2de505734 with Priority: HIGHEST for action port [ 693.749331] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc1c51b9-e499-48dd-8af9-92c2de505734 with Priority: HIGHEST for action port [ 693.749693] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc1c51b9-e499-48dd-8af9-92c2de505734 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.749830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc1c51b9-e499-48dd-8af9-92c2de505734" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.749918] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc1c51b9-e499-48dd-8af9-92c2de505734" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.750398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc1c51b9-e499-48dd-8af9-92c2de505734" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.750398] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc1c51b9-e499-48dd-8af9-92c2de505734',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.914150] env[69343]: INFO networking_nsxv3.common.synchronization [req-45426265-59c2-4a9d-9681-5060e9974bf4 req-ccd7e17e-ac2b-4168-beb1-96d34accfe9f service nova] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_rules [ 693.914150] env[69343]: INFO networking_nsxv3.common.synchronization [req-45426265-59c2-4a9d-9681-5060e9974bf4 req-ccd7e17e-ac2b-4168-beb1-96d34accfe9f service nova] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 693.914150] env[69343]: INFO networking_nsxv3.common.synchronization [req-45426265-59c2-4a9d-9681-5060e9974bf4 req-ccd7e17e-ac2b-4168-beb1-96d34accfe9f service nova] Enqueued Resource ID: bd1240b2-796c-4379-8aa6-cf2a00639048 with Priority: HIGHEST for action port [ 693.918040] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_rules [ 693.918040] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 693.918040] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd1240b2-796c-4379-8aa6-cf2a00639048 with Priority: HIGHEST for action port [ 693.918040] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.918239] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.918561] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.919640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.920772] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.923535] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.923535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.923535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.923535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.923535] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.923535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.923535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.923535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.923535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.923535] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.924787] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd1240b2-796c-4379-8aa6-cf2a00639048 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.924889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd1240b2-796c-4379-8aa6-cf2a00639048" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.925195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd1240b2-796c-4379-8aa6-cf2a00639048" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.925544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd1240b2-796c-4379-8aa6-cf2a00639048" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.925799] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd1240b2-796c-4379-8aa6-cf2a00639048',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.991160] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-254 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.991388] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-254" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.991517] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-254" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.991826] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-254" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.992110] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.992268] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.993075] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.993075] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.993075] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.993075] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.993509] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.993981] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.993981] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.993981] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.994157] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.994306] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.021675] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.021881] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 694.022112] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.022239] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-254" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.022571] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-d5c0e2ee-e265-4f65-b02c-07b400225418 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.022856] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-d5c0e2ee-e265-4f65-b02c-07b400225418" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.022856] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-d5c0e2ee-e265-4f65-b02c-07b400225418" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.023486] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-d5c0e2ee-e265-4f65-b02c-07b400225418" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.023691] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5c0e2ee-e265-4f65-b02c-07b400225418',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.138993] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.139242] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.139319] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.139758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.139758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.139758] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc already deleted. [ 694.139902] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.254906] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc1c51b9-e499-48dd-8af9-92c2de505734 [ 694.254906] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.254906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.254906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.254906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.254906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.254906] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc1c51b9-e499-48dd-8af9-92c2de505734 already deleted. [ 694.254906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc1c51b9-e499-48dd-8af9-92c2de505734" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.429655] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.433709] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.433709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.433709] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd1240b2-796c-4379-8aa6-cf2a00639048 with status ACTIVE [ 694.433709] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.433709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.433709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.433709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.433709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.434443] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.434747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.435220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.435220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.435220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.435400] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.435400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.435541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.435656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.435745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.435818] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd1240b2-796c-4379-8aa6-cf2a00639048 is going to be updated. [ 694.468140] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.468427] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.468427] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.470402] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.470402] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.470730] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd1240b2-796c-4379-8aa6-cf2a00639048" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.527623] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.527623] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.527623] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.527623] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.528270] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.528270] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port d5c0e2ee-e265-4f65-b02c-07b400225418 not found, creating... [ 694.528956] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.529320] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.529598] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.530270] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.530379] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.532194] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.532194] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.532194] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.532194] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.532194] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.532490] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: d5c0e2ee-e265-4f65-b02c-07b400225418 is going to be created. [ 694.558412] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.559064] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.559455] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.559911] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.560317] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.560818] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-d5c0e2ee-e265-4f65-b02c-07b400225418" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.941985] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.446492] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.449285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.449285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.449285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.449285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.449285] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 is going to be created. [ 695.477611] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.477780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.477843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.479064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.479064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.491111] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: UNINITIALIZED for 2s [ 695.957169] env[69343]: INFO networking_nsxv3.common.synchronization [req-45426265-59c2-4a9d-9681-5060e9974bf4 req-9c48fadc-6436-4061-96ee-c53c651f7367 service nova] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_rules [ 695.957454] env[69343]: INFO networking_nsxv3.common.synchronization [req-45426265-59c2-4a9d-9681-5060e9974bf4 req-9c48fadc-6436-4061-96ee-c53c651f7367 service nova] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 695.959032] env[69343]: INFO networking_nsxv3.common.synchronization [req-45426265-59c2-4a9d-9681-5060e9974bf4 req-9c48fadc-6436-4061-96ee-c53c651f7367 service nova] Enqueued Resource ID: d5c0e2ee-e265-4f65-b02c-07b400225418 with Priority: HIGHEST for action port [ 695.959032] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_rules [ 695.959032] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 695.959032] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5c0e2ee-e265-4f65-b02c-07b400225418 with Priority: HIGHEST for action port [ 695.959032] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.959032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.959032] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.960132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.960132] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5c0e2ee-e265-4f65-b02c-07b400225418 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.960132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5c0e2ee-e265-4f65-b02c-07b400225418" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.960132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5c0e2ee-e265-4f65-b02c-07b400225418" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.960132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5c0e2ee-e265-4f65-b02c-07b400225418" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.960132] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5c0e2ee-e265-4f65-b02c-07b400225418',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.042551] env[69343]: INFO networking_nsxv3.common.synchronization [req-a2052150-5e07-4110-a1f2-0f07f974237f req-eb907669-a221-48d7-92e2-fe7b7f41ff61 tempest-ServersAdminTestJSON-624451732 tempest-ServersAdminTestJSON-624451732-project-member] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 696.048506] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 696.050051] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.050051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.050051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.050051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.050051] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.050051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.050051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.050433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.050433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.050433] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.230433] env[69343]: INFO networking_nsxv3.common.synchronization [req-3526edcd-32f6-4e51-b150-6cf0ed95a728 req-a1fe9874-620a-466d-bc08-d388ce6e3aba tempest-ServersTestMultiNic-93755808 tempest-ServersTestMultiNic-93755808-project-member] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 696.231259] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 696.231456] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.231596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.231672] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.231929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.232178] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.232349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.232417] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.232566] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.232653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.232788] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.463274] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5c0e2ee-e265-4f65-b02c-07b400225418 with status ACTIVE [ 696.463546] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.465016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.465016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.465016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.465016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.465016] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.465217] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.465217] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.465325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.465381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.465883] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.465883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.465883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.465883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.466310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.466310] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5c0e2ee-e265-4f65-b02c-07b400225418 is going to be updated. [ 696.494732] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.495092] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.495092] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.495206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.495322] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.495486] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5c0e2ee-e265-4f65-b02c-07b400225418" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.553908] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.572880] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-621 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.573122] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-621" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.573250] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-621" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.574804] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-621" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.574804] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.574804] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.574804] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.574804] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.574804] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.574804] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.574804] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.575262] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.575262] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.575262] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.575384] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.575598] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.612293] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.612293] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 696.612293] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.612293] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-621" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.612293] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-f05cecf6-bfc6-4108-ab36-eda93b68b64f taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.612293] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-f05cecf6-bfc6-4108-ab36-eda93b68b64f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.612293] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-f05cecf6-bfc6-4108-ab36-eda93b68b64f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.612978] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-f05cecf6-bfc6-4108-ab36-eda93b68b64f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.612978] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f05cecf6-bfc6-4108-ab36-eda93b68b64f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.734627] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.911233] env[69343]: INFO networking_nsxv3.common.synchronization [req-3526edcd-32f6-4e51-b150-6cf0ed95a728 req-3a5edcbd-b937-421f-a62a-fa6391025db1 tempest-ServersTestMultiNic-93755808 tempest-ServersTestMultiNic-93755808-project-member] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 696.914449] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 696.914449] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.914449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.056430] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.118272] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.118272] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.118272] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.118272] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.118272] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.118272] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port f05cecf6-bfc6-4108-ab36-eda93b68b64f not found, creating... [ 697.118272] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.118272] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.118272] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.118272] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.118272] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.118822] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.118936] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.119101] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.119348] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.119520] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.119662] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: f05cecf6-bfc6-4108-ab36-eda93b68b64f is going to be created. [ 697.141338] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.141545] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.141694] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.142034] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.142277] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.142523] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-f05cecf6-bfc6-4108-ab36-eda93b68b64f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.236948] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.502187] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: SUCCESS [ 697.502591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.502908] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.503327] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.503650] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.503880] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.504100] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.505022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.505161] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.505448] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.505724] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.507427] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.508021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.508082] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.508337] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.508502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.508913] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.509135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.509681] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.560235] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.563748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.563748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.563748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.563748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.563748] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be updated. [ 697.599038] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.599038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.599038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.599038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.599038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.607540] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: IN_PROGRESS for 2s [ 697.624371] env[69343]: INFO networking_nsxv3.common.synchronization [req-3526edcd-32f6-4e51-b150-6cf0ed95a728 req-5dded3bd-84eb-4ed5-aa1e-6ffcf0d385c8 tempest-ServersTestMultiNic-93755808 tempest-ServersTestMultiNic-93755808-project-member] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 697.624371] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 697.624371] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.624371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.741136] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.741352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.741453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.741747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.741838] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.741964] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be updated. [ 697.798098] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.798332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.798332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.799161] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.799161] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.812727] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: IN_PROGRESS for 2s [ 698.011603] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.011844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.012101] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.126459] env[69343]: INFO networking_nsxv3.common.synchronization [req-a2052150-5e07-4110-a1f2-0f07f974237f req-c17cdad8-88ae-43e7-9939-e0c5259d20c4 service nova] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_rules [ 698.127398] env[69343]: INFO networking_nsxv3.common.synchronization [req-a2052150-5e07-4110-a1f2-0f07f974237f req-c17cdad8-88ae-43e7-9939-e0c5259d20c4 service nova] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 698.127616] env[69343]: INFO networking_nsxv3.common.synchronization [req-a2052150-5e07-4110-a1f2-0f07f974237f req-c17cdad8-88ae-43e7-9939-e0c5259d20c4 service nova] Enqueued Resource ID: f05cecf6-bfc6-4108-ab36-eda93b68b64f with Priority: HIGHEST for action port [ 698.128930] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_rules [ 698.129129] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 698.129232] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f05cecf6-bfc6-4108-ab36-eda93b68b64f with Priority: HIGHEST for action port [ 698.129955] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.131032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.131032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.131032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.131032] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.131458] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.131603] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.132599] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-f05cecf6-bfc6-4108-ab36-eda93b68b64f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.132849] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f05cecf6-bfc6-4108-ab36-eda93b68b64f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.132932] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f05cecf6-bfc6-4108-ab36-eda93b68b64f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.133196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f05cecf6-bfc6-4108-ab36-eda93b68b64f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.133307] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f05cecf6-bfc6-4108-ab36-eda93b68b64f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.516779] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.638234] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.638234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.638644] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f05cecf6-bfc6-4108-ab36-eda93b68b64f with status ACTIVE [ 698.638861] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.639087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.639164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.639384] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.639508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.639708] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.639822] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.639883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.640063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.640142] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.642420] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.642613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.642665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.643248] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.643248] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.643248] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f05cecf6-bfc6-4108-ab36-eda93b68b64f is going to be updated. [ 698.707046] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.707263] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.707394] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.707593] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.708744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.709808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f05cecf6-bfc6-4108-ab36-eda93b68b64f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.931740] env[69343]: INFO networking_nsxv3.common.synchronization [None req-f418485a-be23-43b9-8a42-bcd12e9ba025 None None] Enqueued Resource ID: d0116f3c-dc1b-4869-9942-bc4c9e6595f9 with Priority: HIGHEST for action port [ 698.935641] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0116f3c-dc1b-4869-9942-bc4c9e6595f9 with Priority: HIGHEST for action port [ 698.936208] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0116f3c-dc1b-4869-9942-bc4c9e6595f9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.936552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0116f3c-dc1b-4869-9942-bc4c9e6595f9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.936552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0116f3c-dc1b-4869-9942-bc4c9e6595f9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.936970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0116f3c-dc1b-4869-9942-bc4c9e6595f9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.937108] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0116f3c-dc1b-4869-9942-bc4c9e6595f9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.024326] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.024326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.024326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.024326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.024326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.024326] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 is going to be updated. [ 699.080613] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.080866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.080941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.081243] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.081396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.096496] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: IN_PROGRESS for 2s [ 699.446162] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0116f3c-dc1b-4869-9942-bc4c9e6595f9 [ 699.446162] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.446162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.446162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.446162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.446162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.446162] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0116f3c-dc1b-4869-9942-bc4c9e6595f9 already deleted. [ 699.446162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0116f3c-dc1b-4869-9942-bc4c9e6595f9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.503175] env[69343]: INFO networking_nsxv3.common.synchronization [req-55c36646-4957-4f33-a0b0-d2948fa7aa8d req-f32d605c-a07e-40ae-8ef3-de4ce3c412ef tempest-ServerActionsTestOtherB-1339566970 tempest-ServerActionsTestOtherB-1339566970-project-member] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 699.507910] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 699.507910] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.507910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.507910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.507910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.507910] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.507910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.507910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.507910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.507910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.507910] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.625388] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: SUCCESS [ 699.625388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.625388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.625388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.625388] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.625388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.625388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.625388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.625388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.625388] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.822562] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: SUCCESS [ 699.822770] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.822938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.823185] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.823372] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.823488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.823551] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.823701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.823783] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.823896] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.012639] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.012875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.013232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.013232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.013518] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.013759] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.013878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.013942] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.014175] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.014295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.015295] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 already deleted. [ 700.015295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.127620] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.331726] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.331726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.332105] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.332105] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.332315] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.333227] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.333448] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.333448] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.333732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.333732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.333818] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be updated. [ 700.384160] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.384411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.384541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.384896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.385180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.400073] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: IN_PROGRESS for 2s [ 700.629908] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.714097] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-551 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.714305] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-551" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.714472] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-551" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.715525] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-551" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.715525] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.715525] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.715525] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.715807] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.715807] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.716513] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 700.716953] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.717588] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.717588] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.717588] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 700.717588] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.717779] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.739186] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.739427] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 700.739957] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.739957] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-551" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.740117] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-521e140f-f582-4dd1-9069-b99f08fcc100 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.740245] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-521e140f-f582-4dd1-9069-b99f08fcc100" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.740309] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-521e140f-f582-4dd1-9069-b99f08fcc100" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.740658] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-521e140f-f582-4dd1-9069-b99f08fcc100" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.740790] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('521e140f-f582-4dd1-9069-b99f08fcc100',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.108616] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: SUCCESS [ 701.109372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.109372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.109372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.109549] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.109696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.109696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.109799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.109870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.109955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.110125] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.110219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.110277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.110418] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.110595] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.112868] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.112964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.113162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.113265] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.113632] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.113632] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.138281] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.138461] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.138513] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.138733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.138853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.138921] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be updated. [ 701.171601] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.171601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.171601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.171601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.171601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.189024] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: IN_PROGRESS for 2s [ 701.249265] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.249265] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.249265] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.249265] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.249265] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.249265] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 521e140f-f582-4dd1-9069-b99f08fcc100 not found, creating... [ 701.249265] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.249265] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.249265] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.249265] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.249265] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.249777] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.249777] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.249777] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.250050] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.253318] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.253318] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 521e140f-f582-4dd1-9069-b99f08fcc100 is going to be created. [ 701.274416] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.274629] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.274782] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.275078] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.275311] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.275545] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-521e140f-f582-4dd1-9069-b99f08fcc100" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.606738] env[69343]: INFO networking_nsxv3.common.synchronization [req-cb44eee1-2560-4b10-bac9-b3369be9ad99 req-cab43798-c5c0-448c-953c-16a9d4f4c4e4 tempest-FloatingIPsAssociationNegativeTestJSON-2041735444 tempest-FloatingIPsAssociationNegativeTestJSON-2041735444-project-member] Enqueued Resource ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 with Priority: HIGHEST for action security_group_members [ 701.607325] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 with Priority: HIGHEST for action security_group_members [ 701.607639] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.607762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.607868] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.614278] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.614539] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.614689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.614804] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.615014] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.615118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.615221] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c490ab0a-5a62-4845-ab43-b72f0c00e5c1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.621154] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b7e2ff9-f297-4beb-8beb-6260aaac3c39: rpc.has_security_group_logging(os_id): False [ 701.663513] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.663845] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.663845] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.664431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.664431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.664431] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.664431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.664644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.664750] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.664750] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.667157] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.667157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.667157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.667157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.667157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.667157] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.667157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.667157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.667157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.667157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.667157] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 is going to be created. [ 701.671774] env[69343]: INFO networking_nsxv3.common.synchronization [req-34bd5673-6c1a-416b-9510-b4f3e2396b38 req-a3666d13-c5c6-4d30-8801-f08ccf56a916 tempest-ServersTestBootFromVolume-1350092508 tempest-ServersTestBootFromVolume-1350092508-project-member] Enqueued Resource ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf with Priority: HIGHEST for action security_group_members [ 701.674019] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf with Priority: HIGHEST for action security_group_members [ 701.674019] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-f65fedc2-bd86-4b46-8ea8-95f7086801cf taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.674019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.674019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.674019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.674019] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.674019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.674019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.674525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.674525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.674525] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f65fedc2-bd86-4b46-8ea8-95f7086801cf',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.749065] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.749065] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.749065] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.749292] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.749430] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.762258] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: IN_PROGRESS for 2s [ 701.967582] env[69343]: INFO networking_nsxv3.common.synchronization [None req-33a1cbef-31d6-4512-a5a8-b86ba99ac8f7 None None] Enqueued Resource ID: 3f76ebad-ebed-4805-895b-7c0a3ad374fc with Priority: HIGHEST for action port [ 701.968764] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f76ebad-ebed-4805-895b-7c0a3ad374fc with Priority: HIGHEST for action port [ 701.968764] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f76ebad-ebed-4805-895b-7c0a3ad374fc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.969083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f76ebad-ebed-4805-895b-7c0a3ad374fc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.969083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f76ebad-ebed-4805-895b-7c0a3ad374fc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.972058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f76ebad-ebed-4805-895b-7c0a3ad374fc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.972058] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f76ebad-ebed-4805-895b-7c0a3ad374fc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.090628] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-65 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.092997] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-65" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.092997] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-65" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.093888] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-65" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.094758] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.097043] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.097043] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.097043] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.097043] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.097043] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 702.097043] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.098359] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.101029] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.101029] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 702.101029] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.101029] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.118380] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.118642] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.118759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.119118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.119278] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.119645] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.119810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.119910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.120206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.120332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.120496] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 is going to be updated. [ 702.131771] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.134535] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 702.134535] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.134535] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-65" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.134535] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-dd872273-c348-4b90-a38e-f7c956082c01 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.134535] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-dd872273-c348-4b90-a38e-f7c956082c01" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.134535] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-dd872273-c348-4b90-a38e-f7c956082c01" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.134535] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-dd872273-c348-4b90-a38e-f7c956082c01" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.134535] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd872273-c348-4b90-a38e-f7c956082c01',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.173994] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.173994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.173994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.173994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.173994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.178880] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.179118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.179205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.179522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.179679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.179949] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.180097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.180296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.180375] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.180820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.180820] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf already deleted. [ 702.180820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.183582] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 in Status: IN_PROGRESS for 2s [ 702.351580] env[69343]: INFO networking_nsxv3.common.synchronization [None req-430b2664-f6b2-463c-9a07-72980d4bf41f None None] Enqueued Resource ID: 7c3bf36d-8c0d-4b3a-8384-a6f1538882f9 with Priority: HIGHEST for action port [ 702.352296] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c3bf36d-8c0d-4b3a-8384-a6f1538882f9 with Priority: HIGHEST for action port [ 702.352684] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c3bf36d-8c0d-4b3a-8384-a6f1538882f9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.352827] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c3bf36d-8c0d-4b3a-8384-a6f1538882f9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.352885] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c3bf36d-8c0d-4b3a-8384-a6f1538882f9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.354187] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c3bf36d-8c0d-4b3a-8384-a6f1538882f9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.354187] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c3bf36d-8c0d-4b3a-8384-a6f1538882f9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.414780] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: SUCCESS [ 702.414780] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee deletion is rescheduled due to dependency. [ 702.414780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.414780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.414780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.414780] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.414780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.414780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.414780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.414780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.414780] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.476962] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f76ebad-ebed-4805-895b-7c0a3ad374fc [ 702.478545] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.478545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.478545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.478545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.478545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.478545] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f76ebad-ebed-4805-895b-7c0a3ad374fc already deleted. [ 702.478545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f76ebad-ebed-4805-895b-7c0a3ad374fc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.639789] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.639789] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.639789] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.639789] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.639789] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.639789] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port dd872273-c348-4b90-a38e-f7c956082c01 not found, creating... [ 702.639789] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.639789] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.639789] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.644366] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.644366] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.644366] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.644366] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.644366] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.644366] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.644366] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.644366] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: dd872273-c348-4b90-a38e-f7c956082c01 is going to be created. [ 702.675383] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.675820] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.675820] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.675937] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.676212] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.676442] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-dd872273-c348-4b90-a38e-f7c956082c01" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.742718] env[69343]: INFO networking_nsxv3.common.synchronization [req-0e5ea2be-226b-420f-921b-1ca153d97cf3 req-4b7b25d3-c961-4956-b185-74e828837849 tempest-TenantUsagesTestJSON-923809993 tempest-TenantUsagesTestJSON-923809993-project-member] Enqueued Resource ID: a262f752-6979-47b1-b3be-fd7926447348 with Priority: HIGHEST for action security_group_members [ 702.743359] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a262f752-6979-47b1-b3be-fd7926447348 with Priority: HIGHEST for action security_group_members [ 702.743663] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a262f752-6979-47b1-b3be-fd7926447348 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.743807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.743871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.747028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.747240] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.747357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.747478] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.747713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.748026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.748026] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a262f752-6979-47b1-b3be-fd7926447348',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.859022] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c3bf36d-8c0d-4b3a-8384-a6f1538882f9 [ 702.859022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.859022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.859022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.859388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.859388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.859472] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c3bf36d-8c0d-4b3a-8384-a6f1538882f9 already deleted. [ 702.859573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c3bf36d-8c0d-4b3a-8384-a6f1538882f9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.922248] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.922329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.922446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.924469] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.928507] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.929423] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.931023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.931023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.931023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.931023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.931023] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be updated. [ 702.962367] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.962515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.962588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.962817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.962967] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.988125] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: IN_PROGRESS for 2s [ 703.202065] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: SUCCESS [ 703.202065] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.202065] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.202065] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.202065] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.202386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.202386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.202386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.202495] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.202539] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.206030] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.253825] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.253996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.254081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.254378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.254817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.254817] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.254817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.255290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.255290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.255290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.255290] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a262f752-6979-47b1-b3be-fd7926447348 is going to be updated. [ 703.290614] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.290864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.290864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.291241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.291413] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.304898] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a262f752-6979-47b1-b3be-fd7926447348 in Status: IN_PROGRESS for 2s [ 703.322197] env[69343]: INFO networking_nsxv3.common.synchronization [req-55c36646-4957-4f33-a0b0-d2948fa7aa8d req-4a04079d-b1c4-41b5-9996-2a7d71b599cb service nova] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_rules [ 703.322197] env[69343]: INFO networking_nsxv3.common.synchronization [req-55c36646-4957-4f33-a0b0-d2948fa7aa8d req-4a04079d-b1c4-41b5-9996-2a7d71b599cb service nova] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 703.322197] env[69343]: INFO networking_nsxv3.common.synchronization [req-55c36646-4957-4f33-a0b0-d2948fa7aa8d req-4a04079d-b1c4-41b5-9996-2a7d71b599cb service nova] Enqueued Resource ID: 521e140f-f582-4dd1-9069-b99f08fcc100 with Priority: HIGHEST for action port [ 703.322561] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_rules [ 703.322804] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 703.322970] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521e140f-f582-4dd1-9069-b99f08fcc100 with Priority: HIGHEST for action port [ 703.323213] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.323351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.323422] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.323622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.323700] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.325450] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.325450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.325607] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.325845] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.326536] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.326536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.326713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.327351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.327351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.327351] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.328699] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-521e140f-f582-4dd1-9069-b99f08fcc100 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.329029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-521e140f-f582-4dd1-9069-b99f08fcc100" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.329029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-521e140f-f582-4dd1-9069-b99f08fcc100" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.329198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-521e140f-f582-4dd1-9069-b99f08fcc100" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.329261] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('521e140f-f582-4dd1-9069-b99f08fcc100',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.695627] env[69343]: INFO networking_nsxv3.common.synchronization [req-34bd5673-6c1a-416b-9510-b4f3e2396b38 req-eb12dd4a-1174-461c-8c0c-359e93a71f19 service nova] Enqueued Resource ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf with Priority: HIGHEST for action security_group_rules [ 703.696109] env[69343]: INFO networking_nsxv3.common.synchronization [req-34bd5673-6c1a-416b-9510-b4f3e2396b38 req-eb12dd4a-1174-461c-8c0c-359e93a71f19 service nova] Enqueued Resource ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf with Priority: HIGHEST for action security_group_members [ 703.696109] env[69343]: INFO networking_nsxv3.common.synchronization [req-34bd5673-6c1a-416b-9510-b4f3e2396b38 req-eb12dd4a-1174-461c-8c0c-359e93a71f19 service nova] Enqueued Resource ID: dd872273-c348-4b90-a38e-f7c956082c01 with Priority: HIGHEST for action port [ 703.698026] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf with Priority: HIGHEST for action security_group_rules [ 703.698026] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf with Priority: HIGHEST for action security_group_members [ 703.698026] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd872273-c348-4b90-a38e-f7c956082c01 with Priority: HIGHEST for action port [ 703.698026] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f65fedc2-bd86-4b46-8ea8-95f7086801cf taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.698026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.698026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.698948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.698948] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f65fedc2-bd86-4b46-8ea8-95f7086801cf',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.699282] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-f65fedc2-bd86-4b46-8ea8-95f7086801cf taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.701272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.701272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.701272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.701452] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.701452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.701539] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.701669] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.701761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.701876] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f65fedc2-bd86-4b46-8ea8-95f7086801cf',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.702749] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd872273-c348-4b90-a38e-f7c956082c01 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.703278] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd872273-c348-4b90-a38e-f7c956082c01" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.703278] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd872273-c348-4b90-a38e-f7c956082c01" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.703278] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd872273-c348-4b90-a38e-f7c956082c01" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.703278] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd872273-c348-4b90-a38e-f7c956082c01',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.708897] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.708897] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.708897] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.708897] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.708897] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.708897] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.708897] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.708897] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.709295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.709295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.709295] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.709412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.709412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.709670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.709792] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.709845] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.709881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.710066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.710121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.710913] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.710913] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.775144] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: SUCCESS [ 703.775144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.775144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.775144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.775144] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.831847] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.831994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.832235] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.833450] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 521e140f-f582-4dd1-9069-b99f08fcc100 with status ACTIVE [ 703.833720] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.833893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.833949] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.834216] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.834350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.834584] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.834719] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.834866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.835051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.835168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.835436] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.835792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.835890] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.836114] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.836225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.836351] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 521e140f-f582-4dd1-9069-b99f08fcc100 is going to be updated. [ 703.859870] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.860058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.860124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.860342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.860518] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.860882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-521e140f-f582-4dd1-9069-b99f08fcc100" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.195278] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 in Status: SUCCESS [ 704.195459] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c490ab0a-5a62-4845-ab43-b72f0c00e5c1 deletion is rescheduled due to dependency. [ 704.195572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c490ab0a-5a62-4845-ab43-b72f0c00e5c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.207939] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-f65fedc2-bd86-4b46-8ea8-95f7086801cf taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.207939] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.211273] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd872273-c348-4b90-a38e-f7c956082c01 with status ACTIVE [ 704.211273] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.213904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.213968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.216520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.216520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.216520] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.216520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.216520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.216520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.216520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.216520] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.216520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.216520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.216520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.216520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.216520] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd872273-c348-4b90-a38e-f7c956082c01 is going to be updated. [ 704.218345] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f65fedc2-bd86-4b46-8ea8-95f7086801cf',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.220717] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a: rpc.has_security_group_logging(os_id): False [ 704.239703] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.239869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.239915] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.240137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.240225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.240488] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.240632] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.240632] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.240720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.240795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.241122] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.241216] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.241276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.241418] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.241500] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.241695] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.241784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.241842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.241977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.242059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.242142] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be updated. [ 704.244038] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.244353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.244353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.244480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.244528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.244659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd872273-c348-4b90-a38e-f7c956082c01" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.278052] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.278296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.278296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.278504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.278683] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.278780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.278837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.278984] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.279083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.279172] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.279262] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.309402] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.309601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.309683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.309891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.310051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.329801] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: IN_PROGRESS for 2s [ 704.339941] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.724529] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f65fedc2-bd86-4b46-8ea8-95f7086801cf',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.783795] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.784066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.784131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.784345] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.784525] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.786108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.786108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.786108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.786108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.786108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.786108] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.786108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.786108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.786108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.786108] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.786108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.786108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.786108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.786108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.786108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.786108] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.845028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.845028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.845028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.845229] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.845229] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.845339] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 is going to be created. [ 704.872702] env[69343]: INFO networking_nsxv3.common.synchronization [None req-21a26b0c-7f3c-4c8e-8531-69bdec4e12a6 None None] Enqueued Resource ID: f3d30e77-a86b-4113-a18d-cf3c53baf4db with Priority: HIGHEST for action port [ 704.873919] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.874235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.874650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.876814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.876990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.878734] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d30e77-a86b-4113-a18d-cf3c53baf4db with Priority: HIGHEST for action port [ 704.879057] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3d30e77-a86b-4113-a18d-cf3c53baf4db taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.879226] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3d30e77-a86b-4113-a18d-cf3c53baf4db" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.879300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3d30e77-a86b-4113-a18d-cf3c53baf4db" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.879613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3d30e77-a86b-4113-a18d-cf3c53baf4db" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.879713] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3d30e77-a86b-4113-a18d-cf3c53baf4db',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.892569] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: UNINITIALIZED for 2s [ 704.911200] env[69343]: INFO networking_nsxv3.common.synchronization [req-bae5133c-f030-4ef7-8bbd-4bf198df4cde req-357a6f68-fcf0-429f-b114-f316406fcb47 tempest-AttachInterfacesUnderV243Test-231606422 tempest-AttachInterfacesUnderV243Test-231606422-project-member] Enqueued Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_members [ 704.911835] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_members [ 704.913577] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.914225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.914362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.914661] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.914915] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.915101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.915208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.915586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.915810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.915810] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.000400] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: SUCCESS [ 705.000400] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee deletion is rescheduled due to dependency. [ 705.000400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.034211] env[69343]: INFO networking_nsxv3.common.synchronization [req-bae5133c-f030-4ef7-8bbd-4bf198df4cde req-357a6f68-fcf0-429f-b114-f316406fcb47 tempest-AttachInterfacesUnderV243Test-231606422 tempest-AttachInterfacesUnderV243Test-231606422-project-member] Enqueued Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_rules [ 705.034211] env[69343]: INFO networking_nsxv3.common.synchronization [req-bae5133c-f030-4ef7-8bbd-4bf198df4cde req-357a6f68-fcf0-429f-b114-f316406fcb47 tempest-AttachInterfacesUnderV243Test-231606422 tempest-AttachInterfacesUnderV243Test-231606422-project-member] Enqueued Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_members [ 705.034211] env[69343]: INFO networking_nsxv3.common.synchronization [req-bae5133c-f030-4ef7-8bbd-4bf198df4cde req-357a6f68-fcf0-429f-b114-f316406fcb47 tempest-AttachInterfacesUnderV243Test-231606422 tempest-AttachInterfacesUnderV243Test-231606422-project-member] Enqueued Resource ID: cdb9a5c8-951f-47ce-9085-2662aa3a65c2 with Priority: HIGHEST for action port [ 705.034705] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_rules [ 705.034852] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_members [ 705.034952] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb9a5c8-951f-47ce-9085-2662aa3a65c2 with Priority: HIGHEST for action port [ 705.035260] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.035391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.035460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.035669] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.035757] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.036683] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.036789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.036993] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.037112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.037180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.037363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.037443] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdb9a5c8-951f-47ce-9085-2662aa3a65c2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.230182] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.234084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.234084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.234084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.234084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.234084] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf is going to be created. [ 705.265020] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.265020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.265020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.265020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.265362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.278537] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf in Status: UNINITIALIZED for 2s [ 705.291062] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b7e2ff9-f297-4beb-8beb-6260aaac3c39: rpc.has_security_group_logging(os_id): False [ 705.327847] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a262f752-6979-47b1-b3be-fd7926447348 in Status: SUCCESS [ 705.328104] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a262f752-6979-47b1-b3be-fd7926447348 deletion is rescheduled due to dependency. [ 705.328152] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.329128] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.329242] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.329311] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.329531] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.329641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.329840] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.329941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.330010] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.332940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.333080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.333346] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.333454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.333518] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.333684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.333806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.341029] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.341029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.341029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.341029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.341029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.341029] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 is going to be updated. [ 705.383497] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3d30e77-a86b-4113-a18d-cf3c53baf4db [ 705.383853] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.384391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.384391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.384391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.384391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.384653] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3d30e77-a86b-4113-a18d-cf3c53baf4db already deleted. [ 705.384653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3d30e77-a86b-4113-a18d-cf3c53baf4db" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.423444] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.425447] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.425622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.425679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.425858] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.426015] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.444376] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: IN_PROGRESS for 2s [ 705.543036] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.543036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.543036] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cdb9a5c8-951f-47ce-9085-2662aa3a65c2 with status ACTIVE [ 705.543036] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.543036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.543036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.543036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.543036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.543036] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.543036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.543036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.543036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.543036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.543036] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.543760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.543760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.548319] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.548319] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.548319] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cdb9a5c8-951f-47ce-9085-2662aa3a65c2 is going to be updated. [ 705.588099] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.588574] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.588803] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.589071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.589240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.589723] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.700010] env[69343]: INFO networking_nsxv3.common.synchronization [None req-82eade7d-6b07-429f-b9ca-f66cc7eedf35 None None] Enqueued Resource ID: 3c1c347b-1c30-42e9-b0f1-612617f0b161 with Priority: HIGHEST for action port [ 705.702043] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c1c347b-1c30-42e9-b0f1-612617f0b161 with Priority: HIGHEST for action port [ 705.702043] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c1c347b-1c30-42e9-b0f1-612617f0b161 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.702043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c1c347b-1c30-42e9-b0f1-612617f0b161" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.702043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c1c347b-1c30-42e9-b0f1-612617f0b161" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.702579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c1c347b-1c30-42e9-b0f1-612617f0b161" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.702803] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c1c347b-1c30-42e9-b0f1-612617f0b161',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.928634] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.209476] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c1c347b-1c30-42e9-b0f1-612617f0b161 [ 706.209922] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.210076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.210268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.212134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.212134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.212134] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c1c347b-1c30-42e9-b0f1-612617f0b161 already deleted. [ 706.212134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c1c347b-1c30-42e9-b0f1-612617f0b161" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.354890] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: SUCCESS [ 706.356115] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.435268] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.435268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.435268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.435446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.435938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.435938] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 is going to be updated. [ 706.489676] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.489676] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.489676] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.490483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.490483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.508240] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: IN_PROGRESS for 2s [ 706.656182] env[69343]: INFO networking_nsxv3.common.synchronization [None req-8d92451c-3425-4a24-928d-2411972a89f9 tempest-AttachVolumeTestJSON-1370042024 tempest-AttachVolumeTestJSON-1370042024-project-member] Enqueued Resource ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b with Priority: HIGHEST for action security_group_rules [ 706.656899] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b with Priority: HIGHEST for action security_group_rules [ 706.657255] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.657405] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.657478] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.658125] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.658125] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.907214] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: SUCCESS [ 706.907214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.907214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.907214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.907214] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.907214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.907214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.908504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.908609] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.909647] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.909647] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.937959] env[69343]: INFO networking_nsxv3.common.synchronization [None req-627b8a49-305c-451e-a562-81a5cd4f9513 tempest-ServerActionsTestJSON-1397784852 tempest-ServerActionsTestJSON-1397784852-project-member] Enqueued Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_rules [ 706.938562] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_rules [ 706.938910] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.940956] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.941190] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.941573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.942924] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.121294] env[69343]: INFO networking_nsxv3.common.synchronization [None req-0c1503ef-c149-4047-987c-848d1890ee46 tempest-AttachVolumeTestJSON-1370042024 tempest-AttachVolumeTestJSON-1370042024-project-member] Enqueued Resource ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b with Priority: HIGHEST for action security_group_rules [ 707.121917] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b with Priority: HIGHEST for action security_group_rules [ 707.124163] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.124315] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.181586] env[69343]: INFO networking_nsxv3.common.synchronization [None req-ef6e08a9-5128-44aa-907f-388388062cdb tempest-ServerActionsTestJSON-1397784852 tempest-ServerActionsTestJSON-1397784852-project-member] Enqueued Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_rules [ 707.182107] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.182107] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.182440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.182440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.182440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.182569] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b already deleted. [ 707.182623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.186515] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_rules [ 707.186515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.186515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.186515] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.186515] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.186515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.298176] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf in Status: SUCCESS [ 707.298176] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.298176] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.298176] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.298817] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.298817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.298817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.298817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.299020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.299020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.299116] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f65fedc2-bd86-4b46-8ea8-95f7086801cf',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.412038] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.457291] env[69343]: INFO networking_nsxv3.common.synchronization [req-21a39f48-3e08-4c4e-86d3-fb32723a932c req-0a7e8dcb-0c54-49ee-bab4-3a93bb8db60d tempest-ServerTagsTestJSON-531325346 tempest-ServerTagsTestJSON-531325346-project-member] Enqueued Resource ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c with Priority: HIGHEST for action security_group_members [ 707.457924] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c with Priority: HIGHEST for action security_group_members [ 707.459288] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.459588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.459588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.459874] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.460215] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.460337] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.460397] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.460576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.460698] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.460871] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.462821] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: SUCCESS [ 707.463088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.464589] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.464715] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.464802] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.465015] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.465156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.465267] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 already deleted. [ 707.465456] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.466884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.466884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.466884] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.629872] env[69343]: INFO networking_nsxv3.common.synchronization [None req-058285f6-1f3d-42d7-b246-544d43eb7f9d None None] Enqueued Resource ID: 10ef8ea4-95f2-495a-aeba-1cb2d8f82c60 with Priority: HIGHEST for action port [ 707.629962] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ef8ea4-95f2-495a-aeba-1cb2d8f82c60 with Priority: HIGHEST for action port [ 707.632019] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-10ef8ea4-95f2-495a-aeba-1cb2d8f82c60 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.632019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10ef8ea4-95f2-495a-aeba-1cb2d8f82c60" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.636264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10ef8ea4-95f2-495a-aeba-1cb2d8f82c60" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.636264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10ef8ea4-95f2-495a-aeba-1cb2d8f82c60" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.636264] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10ef8ea4-95f2-495a-aeba-1cb2d8f82c60',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.706842] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.707011] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.707077] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.707291] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.707372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.707487] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b already deleted. [ 707.707652] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.803098] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f65fedc2-bd86-4b46-8ea8-95f7086801cf',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.913682] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 970edbb8-6a58-46c8-ad52-fe607c6c28e9: rpc.has_security_group_logging(os_id): False [ 707.934766] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.936979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.936979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.936979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.936979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.936979] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.936979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.936979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.936979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.936979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.936979] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 is going to be created. [ 707.966930] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.966930] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.966930] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.967234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.967234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.967374] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.967374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.967474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.967568] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.967644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.967728] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c already deleted. [ 707.967806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.987588] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.987831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.987831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.989233] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.989381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.989670] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 already deleted. [ 707.989777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.001015] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.001214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.001214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.001401] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.001586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.014200] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: IN_PROGRESS for 2s [ 708.139827] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10ef8ea4-95f2-495a-aeba-1cb2d8f82c60 [ 708.140198] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.140398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.140494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.140779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.140910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.141059] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10ef8ea4-95f2-495a-aeba-1cb2d8f82c60 already deleted. [ 708.141171] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10ef8ea4-95f2-495a-aeba-1cb2d8f82c60" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.317596] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f65fedc2-bd86-4b46-8ea8-95f7086801cf: rpc.has_security_group_logging(os_id): False [ 708.327921] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.328196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.328196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.328462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.328619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.329978] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.329978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.329978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.329978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.329978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.329978] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf is going to be created. [ 708.414432] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.414589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.414642] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.416903] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.417010] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.433142] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf in Status: IN_PROGRESS for 2s [ 708.480208] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-629 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.480208] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-629" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.480208] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-629" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.480208] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-629" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.480208] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.480208] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.480208] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.480208] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.480208] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.480617] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 708.480617] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.480696] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.480758] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.480867] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 708.480979] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.481126] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.517093] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.517336] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 708.517501] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.518021] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-629" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.518580] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-91882c0f-ba92-4cab-9589-81a241766aa7 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.518884] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-91882c0f-ba92-4cab-9589-81a241766aa7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.519624] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-91882c0f-ba92-4cab-9589-81a241766aa7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.520191] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-91882c0f-ba92-4cab-9589-81a241766aa7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.520524] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91882c0f-ba92-4cab-9589-81a241766aa7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.523225] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: SUCCESS [ 708.523596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.524250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.524696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.524966] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.525224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.525400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.525896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.526131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.526364] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.025786] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.026170] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.026246] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.026536] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.026690] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.026936] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 91882c0f-ba92-4cab-9589-81a241766aa7 not found, creating... [ 709.027245] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.027408] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.027527] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.027761] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.027914] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.028248] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.028402] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.028548] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.028771] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.028912] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.029661] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 91882c0f-ba92-4cab-9589-81a241766aa7 is going to be created. [ 709.032545] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.061510] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.061706] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.061868] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.062196] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.062434] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.062762] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-91882c0f-ba92-4cab-9589-81a241766aa7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.538025] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.028471] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: SUCCESS [ 710.028471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.041515] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.041515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.041515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.041515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.041515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.041515] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 is going to be updated. [ 710.084074] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.084074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.084074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.084074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.084074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.097858] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: IN_PROGRESS for 2s [ 710.448831] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf in Status: SUCCESS [ 710.449095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.554431] env[69343]: INFO networking_nsxv3.common.synchronization [req-67557073-e037-40f9-8707-fd49f26d30c9 req-5124842d-3556-45ae-b6b5-ebfe1228a402 tempest-ServersTestJSON-1071315481 tempest-ServersTestJSON-1071315481-project-member] Enqueued Resource ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 with Priority: HIGHEST for action security_group_members [ 710.555008] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 with Priority: HIGHEST for action security_group_members [ 710.555321] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fd7d44f-0622-4667-b3c0-6139a73c5a07 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.555447] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.555514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.555713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.555868] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.555962] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.556040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.556192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.556278] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.556369] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fd7d44f-0622-4667-b3c0-6139a73c5a07',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.660777] env[69343]: INFO networking_nsxv3.common.synchronization [req-21a39f48-3e08-4c4e-86d3-fb32723a932c req-830d0ca2-d861-4eea-a614-a2a6534ad5d0 service nova] Enqueued Resource ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c with Priority: HIGHEST for action security_group_rules [ 710.661134] env[69343]: INFO networking_nsxv3.common.synchronization [req-21a39f48-3e08-4c4e-86d3-fb32723a932c req-830d0ca2-d861-4eea-a614-a2a6534ad5d0 service nova] Enqueued Resource ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c with Priority: HIGHEST for action security_group_members [ 710.661256] env[69343]: INFO networking_nsxv3.common.synchronization [req-21a39f48-3e08-4c4e-86d3-fb32723a932c req-830d0ca2-d861-4eea-a614-a2a6534ad5d0 service nova] Enqueued Resource ID: 91882c0f-ba92-4cab-9589-81a241766aa7 with Priority: HIGHEST for action port [ 710.661892] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c with Priority: HIGHEST for action security_group_rules [ 710.664108] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c with Priority: HIGHEST for action security_group_members [ 710.664108] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91882c0f-ba92-4cab-9589-81a241766aa7 with Priority: HIGHEST for action port [ 710.664108] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.664108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.664108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.664108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.664108] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.668204] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.668204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.668204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.668204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.668204] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.668204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.668204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.668204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.668204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.668204] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.668204] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-91882c0f-ba92-4cab-9589-81a241766aa7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.668204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91882c0f-ba92-4cab-9589-81a241766aa7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.668204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91882c0f-ba92-4cab-9589-81a241766aa7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.668204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91882c0f-ba92-4cab-9589-81a241766aa7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.668204] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91882c0f-ba92-4cab-9589-81a241766aa7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.058480] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.058785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.058785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.058935] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.058993] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.059199] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.059334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.059382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.059507] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.059690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.059770] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 is going to be updated. [ 711.090343] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.090501] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.090643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.090812] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.090977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.101201] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 in Status: IN_PROGRESS for 2s [ 711.165917] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.166070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.170504] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91882c0f-ba92-4cab-9589-81a241766aa7 with status ACTIVE [ 711.170750] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.170894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.170966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.171193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.171276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.171554] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.171554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.171658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.171761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.171841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.172053] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.172162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.172208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.172374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.172564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.172564] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91882c0f-ba92-4cab-9589-81a241766aa7 is going to be updated. [ 711.173639] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.194204] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.194395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.194431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.194618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.194752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.194915] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91882c0f-ba92-4cab-9589-81a241766aa7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.572893] env[69343]: INFO networking_nsxv3.common.synchronization [req-d8cb535e-bf90-4f5f-9d07-e6d896217e85 req-3e516f1f-d456-48d1-bf1d-ee4670c1864d tempest-MultipleCreateTestJSON-1171017912 tempest-MultipleCreateTestJSON-1171017912-project-member] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 711.574190] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 711.574376] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.574427] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.574519] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.574814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.575059] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.575203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.575292] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.575518] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.575652] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.575788] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.677034] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.748121] env[69343]: INFO networking_nsxv3.common.synchronization [req-79734a93-9aad-4b72-b9a1-67a1ff565339 req-215e7185-d984-427d-b1da-3d0711e1320f tempest-DeleteServersAdminTestJSON-2146523094 tempest-DeleteServersAdminTestJSON-2146523094-project-member] Enqueued Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGHEST for action security_group_members [ 711.748240] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGHEST for action security_group_members [ 711.748684] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4754c815-e215-49af-b64e-e52ebe2b915e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.748859] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.748916] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.749208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.749428] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.749567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.749733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.749980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.749980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.750098] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.078798] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.093437] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.093730] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.093936] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.094375] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.094856] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.095139] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.095448] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.095628] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.095795] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.096055] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 712.096190] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.096305] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.096424] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.096536] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 712.096641] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.096811] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 712.109642] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: SUCCESS [ 712.109899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.110088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.110387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.110508] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.110632] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.110701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.110873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.110956] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.111074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.111171] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.135363] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 712.135860] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 712.136476] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 712.136476] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.136690] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-f72d5b30-25b0-4a40-b93e-7efc43001074 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.136937] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-f72d5b30-25b0-4a40-b93e-7efc43001074" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.142072] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-f72d5b30-25b0-4a40-b93e-7efc43001074" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.142072] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-f72d5b30-25b0-4a40-b93e-7efc43001074" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.142072] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f72d5b30-25b0-4a40-b93e-7efc43001074',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.151725] env[69343]: INFO networking_nsxv3.common.synchronization [req-2fae515a-dada-45c0-adc1-a856174e4fb7 req-fafc686f-4a99-49d4-b7e2-fc43c000f133 tempest-AttachInterfacesUnderV243Test-231606422 tempest-AttachInterfacesUnderV243Test-231606422-project-member] Enqueued Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_members [ 712.156154] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_members [ 712.156923] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.157090] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.157182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.157407] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.157626] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.157684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.157748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.158845] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.158845] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.158845] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.183459] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.183459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.183459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.183718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.183781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.183893] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c is going to be created. [ 712.194117] env[69343]: INFO networking_nsxv3.common.synchronization [req-2fae515a-dada-45c0-adc1-a856174e4fb7 req-fafc686f-4a99-49d4-b7e2-fc43c000f133 tempest-AttachInterfacesUnderV243Test-231606422 tempest-AttachInterfacesUnderV243Test-231606422-project-member] Enqueued Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_rules [ 712.194117] env[69343]: INFO networking_nsxv3.common.synchronization [req-2fae515a-dada-45c0-adc1-a856174e4fb7 req-fafc686f-4a99-49d4-b7e2-fc43c000f133 tempest-AttachInterfacesUnderV243Test-231606422 tempest-AttachInterfacesUnderV243Test-231606422-project-member] Enqueued Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_members [ 712.194117] env[69343]: INFO networking_nsxv3.common.synchronization [req-2fae515a-dada-45c0-adc1-a856174e4fb7 req-fafc686f-4a99-49d4-b7e2-fc43c000f133 tempest-AttachInterfacesUnderV243Test-231606422 tempest-AttachInterfacesUnderV243Test-231606422-project-member] Enqueued Resource ID: cdb9a5c8-951f-47ce-9085-2662aa3a65c2 with Priority: HIGHEST for action port [ 712.194117] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_rules [ 712.194117] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_members [ 712.194117] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb9a5c8-951f-47ce-9085-2662aa3a65c2 with Priority: HIGHEST for action port [ 712.194279] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.194348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.194557] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.194601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.194774] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.194875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.194938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.195231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.195447] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdb9a5c8-951f-47ce-9085-2662aa3a65c2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.215871] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.215871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.215871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.218113] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.218113] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.228513] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c in Status: UNINITIALIZED for 2s [ 712.252108] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.252405] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.252589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.252937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.253168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.253489] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.253663] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.253802] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.254107] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.254318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.254511] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4754c815-e215-49af-b64e-e52ebe2b915e is going to be updated. [ 712.290145] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.290301] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.290382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.290630] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.290872] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.306454] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4754c815-e215-49af-b64e-e52ebe2b915e in Status: IN_PROGRESS for 2s [ 712.581017] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.613909] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.650430] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.650877] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.651108] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.651439] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.651597] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.651834] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port f72d5b30-25b0-4a40-b93e-7efc43001074 not found, creating... [ 712.652288] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.652631] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.652829] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.653734] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.653896] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.654356] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.654963] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.654963] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.655183] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.655315] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.655509] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: f72d5b30-25b0-4a40-b93e-7efc43001074 is going to be created. [ 712.662816] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.688737] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.688970] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.689070] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.689350] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.689572] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.689875] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-f72d5b30-25b0-4a40-b93e-7efc43001074" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.697707] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cdb9a5c8-951f-47ce-9085-2662aa3a65c2 with status ACTIVE [ 712.697947] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.698108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.699219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.699219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.699219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.699219] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.699219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.699219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.699219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.699219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.699219] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.699219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.699773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.699773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.699773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.699773] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cdb9a5c8-951f-47ce-9085-2662aa3a65c2 is going to be updated. [ 712.723448] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.723448] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.723448] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.723585] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.723699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.723852] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdb9a5c8-951f-47ce-9085-2662aa3a65c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.083813] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.084208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.084208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.084653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.084762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.084873] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 is going to be updated. [ 713.112848] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 in Status: SUCCESS [ 713.113102] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 deletion is rescheduled due to dependency. [ 713.114640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.115736] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c52eea06-29db-49da-b0fb-ebb6ba4a8d86: rpc.has_security_group_logging(os_id): False [ 713.119198] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.119399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.119496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.121016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.121016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.135115] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: IN_PROGRESS for 2s [ 713.136907] env[69343]: INFO networking_nsxv3.common.synchronization [req-996dba3d-3881-44de-a786-f91c36dffa18 req-d178f75a-7b36-415a-a912-6ed566738388 tempest-MultipleCreateTestJSON-1171017912 tempest-MultipleCreateTestJSON-1171017912-project-member] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 713.137139] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 713.137760] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.137888] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.139515] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.140316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.140316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.140316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.140316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.140316] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.140828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.140828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.140828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.140828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.140828] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 is going to be updated. [ 713.164871] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.224237] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.224237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.224237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.224237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.224237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.240565] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: IN_PROGRESS for 2s [ 713.669061] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.669323] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.669423] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.669715] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.669780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.669864] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 is going to be updated. [ 713.702695] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.702901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.702901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.703145] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.703300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.714354] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: IN_PROGRESS for 2s [ 713.843707] env[69343]: INFO networking_nsxv3.common.synchronization [req-79734a93-9aad-4b72-b9a1-67a1ff565339 req-5f260467-54ff-418f-b0b6-d4c8491b28b0 service nova] Enqueued Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGHEST for action security_group_rules [ 713.843925] env[69343]: INFO networking_nsxv3.common.synchronization [req-79734a93-9aad-4b72-b9a1-67a1ff565339 req-5f260467-54ff-418f-b0b6-d4c8491b28b0 service nova] Enqueued Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGHEST for action security_group_members [ 713.844079] env[69343]: INFO networking_nsxv3.common.synchronization [req-79734a93-9aad-4b72-b9a1-67a1ff565339 req-5f260467-54ff-418f-b0b6-d4c8491b28b0 service nova] Enqueued Resource ID: f72d5b30-25b0-4a40-b93e-7efc43001074 with Priority: HIGHEST for action port [ 713.844657] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGHEST for action security_group_rules [ 713.844758] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGHEST for action security_group_members [ 713.844848] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f72d5b30-25b0-4a40-b93e-7efc43001074 with Priority: HIGHEST for action port [ 713.845196] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4754c815-e215-49af-b64e-e52ebe2b915e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.845315] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.845388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.845582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.845661] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.846522] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4754c815-e215-49af-b64e-e52ebe2b915e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.846615] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.846794] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-f72d5b30-25b0-4a40-b93e-7efc43001074 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.846889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f72d5b30-25b0-4a40-b93e-7efc43001074" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.846949] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f72d5b30-25b0-4a40-b93e-7efc43001074" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.847129] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f72d5b30-25b0-4a40-b93e-7efc43001074" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.847212] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f72d5b30-25b0-4a40-b93e-7efc43001074',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.241177] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c in Status: SUCCESS [ 714.242555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.243593] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.243860] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.244081] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.244302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.244302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.244423] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.244506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.244588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.244677] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.321031] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4754c815-e215-49af-b64e-e52ebe2b915e in Status: SUCCESS [ 714.321031] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4754c815-e215-49af-b64e-e52ebe2b915e deletion is rescheduled due to dependency. [ 714.321031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.321031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.321031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.321031] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.321031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.321031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.321031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.321031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.321031] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.349673] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4754c815-e215-49af-b64e-e52ebe2b915e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.349673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.352519] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f72d5b30-25b0-4a40-b93e-7efc43001074 with status ACTIVE [ 714.353655] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.353655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.353655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.357018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.357018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.357018] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.357018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.357018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.357018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.357018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.357018] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.357018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.357018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.357018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.357018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.357018] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f72d5b30-25b0-4a40-b93e-7efc43001074 is going to be updated. [ 714.385371] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.385371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.385371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.385371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.385371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.385371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f72d5b30-25b0-4a40-b93e-7efc43001074" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.747343] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.747600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.747769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.750403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.750403] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.750403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.750403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.750403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.750403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.750403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.750403] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.750403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.750403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.750403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.754569] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.754734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.754734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.757249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.757249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.757249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.757249] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.824380] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.887266] env[69343]: INFO networking_nsxv3.common.synchronization [req-31a8ce7b-c06e-4d52-9474-bd53b5b6e448 req-ea3f75ff-1992-4f8d-a78f-ae511b40fc43 tempest-ImagesTestJSON-628353040 tempest-ImagesTestJSON-628353040-project-member] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 714.887350] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 714.888147] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.888319] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.888536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.888779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.888946] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.889069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.889202] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.889374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.889465] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.889580] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.152214] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: SUCCESS [ 715.152450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.153048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.153276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.153463] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.153728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.153728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.153853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.153853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.154538] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.256404] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: SUCCESS [ 715.256696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.257711] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.257711] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.257711] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.258277] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c: rpc.has_security_group_logging(os_id): False [ 715.278089] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.278089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.278089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.278089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.278089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.278089] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.278089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.278089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.278089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.278089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.278089] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.278533] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.278533] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.278533] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.278533] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.278674] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.278744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.278744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.278938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.282554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.282765] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c is going to be created. [ 715.328414] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.350266] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.350266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.350266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.350506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.350550] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.363350] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c in Status: IN_PROGRESS for 2s [ 715.380192] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-308 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.380548] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.380722] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.381391] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.381949] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.382117] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.382286] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.382902] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.383180] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.383545] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.383731] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.383983] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.384229] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.384439] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.384501] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.384832] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.391574] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.391574] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.391748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.392112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.392373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.392448] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.392597] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.392703] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.392946] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.393100] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.393246] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 715.404898] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.404944] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 715.405227] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.405300] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.405623] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-0724114c-2be0-48f3-b047-28a96e39a968 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.405795] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-0724114c-2be0-48f3-b047-28a96e39a968" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.405911] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-0724114c-2be0-48f3-b047-28a96e39a968" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.406275] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-0724114c-2be0-48f3-b047-28a96e39a968" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.406426] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0724114c-2be0-48f3-b047-28a96e39a968',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.437860] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.438018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.438090] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.438447] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.438447] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.462830] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 715.657267] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.657412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.657480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.657749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.657843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.658064] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.659019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.659019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.659019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.659019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.659019] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 is going to be updated. [ 715.695154] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.695154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.695154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.695154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.695154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.704340] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: IN_PROGRESS for 2s [ 715.725553] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: SUCCESS [ 715.725553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.725746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.725926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.726144] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.726266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.726329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.726491] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.726575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.726673] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.760821] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.761155] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.832639] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.832893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.832893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.833205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.833205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.833340] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4754c815-e215-49af-b64e-e52ebe2b915e is going to be updated. [ 715.866474] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.866474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.866474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.866649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.866704] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.879792] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4754c815-e215-49af-b64e-e52ebe2b915e in Status: IN_PROGRESS for 2s [ 715.912816] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.913397] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.913568] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.913908] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.914110] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.914290] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 0724114c-2be0-48f3-b047-28a96e39a968 not found, creating... [ 715.914603] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.914778] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.914909] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.915193] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.915334] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.915622] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.915785] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.915896] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.916288] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.916424] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.916562] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 0724114c-2be0-48f3-b047-28a96e39a968 is going to be created. [ 715.939452] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.939720] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.939852] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.940143] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.940375] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.940600] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-0724114c-2be0-48f3-b047-28a96e39a968" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.229395] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.735238] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.922477] env[69343]: INFO networking_nsxv3.common.synchronization [req-31a8ce7b-c06e-4d52-9474-bd53b5b6e448 req-261f399e-4843-4e12-b216-796e5f5e9131 service nova] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_rules [ 716.923526] env[69343]: INFO networking_nsxv3.common.synchronization [req-31a8ce7b-c06e-4d52-9474-bd53b5b6e448 req-261f399e-4843-4e12-b216-796e5f5e9131 service nova] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 716.923526] env[69343]: INFO networking_nsxv3.common.synchronization [req-31a8ce7b-c06e-4d52-9474-bd53b5b6e448 req-261f399e-4843-4e12-b216-796e5f5e9131 service nova] Enqueued Resource ID: 0724114c-2be0-48f3-b047-28a96e39a968 with Priority: HIGHEST for action port [ 716.923526] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_rules [ 716.923526] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 716.923526] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0724114c-2be0-48f3-b047-28a96e39a968 with Priority: HIGHEST for action port [ 716.924914] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.924914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.924914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.926338] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.926498] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.928981] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.929084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.930926] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-0724114c-2be0-48f3-b047-28a96e39a968 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.931104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0724114c-2be0-48f3-b047-28a96e39a968" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.932393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0724114c-2be0-48f3-b047-28a96e39a968" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.932393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0724114c-2be0-48f3-b047-28a96e39a968" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.932393] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0724114c-2be0-48f3-b047-28a96e39a968',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.237751] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.237918] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.238075] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.238300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.238392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.238487] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 is going to be updated. [ 717.271430] env[69343]: INFO networking_nsxv3.common.synchronization [req-1d1f1cb9-89d5-4d76-8f5d-4c33bfdb2ec0 req-29ecdade-6607-4cb0-8dd2-ef76f26d8e94 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 717.271430] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 717.271808] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.271955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.272079] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.272380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.272562] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.272682] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.272760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.273193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.273193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.273193] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.286914] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.286914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.286914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.286914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.286914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.297450] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: IN_PROGRESS for 2s [ 717.391475] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c in Status: SUCCESS [ 717.391475] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.433924] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.433924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.437606] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0724114c-2be0-48f3-b047-28a96e39a968 with status ACTIVE [ 717.438015] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.438234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.438354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.438672] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.438826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.439135] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.441186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.441186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.441186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.441186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.441186] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.441336] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.441336] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.441518] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.441905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.442048] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0724114c-2be0-48f3-b047-28a96e39a968 is going to be updated. [ 717.466108] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.466438] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.466438] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.466579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.467455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.467455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0724114c-2be0-48f3-b047-28a96e39a968" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.479245] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 717.479245] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b deletion is rescheduled due to dependency. [ 717.479245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.479245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.479245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.479245] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.479245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.479245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.479245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.479245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.479547] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.717058] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: SUCCESS [ 717.717376] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 deletion is rescheduled due to dependency. [ 717.717504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.756876] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-521 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.757341] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-521" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.757341] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-521" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.757584] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-521" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.758057] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.758259] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.758378] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.758603] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.758763] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.758972] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.759096] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.759205] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.759313] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.759423] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.759527] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.759700] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.776153] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.776348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.776401] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.776618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.776714] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.776920] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.777036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.777099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.777261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.777356] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.777474] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b already deleted. [ 717.777582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.779113] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.779113] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 717.779917] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.779917] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-521" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.779917] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-c16018cb-b1d5-479e-be9c-68b0ecbb4549 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.779917] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-c16018cb-b1d5-479e-be9c-68b0ecbb4549" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.780127] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-c16018cb-b1d5-479e-be9c-68b0ecbb4549" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.780294] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-c16018cb-b1d5-479e-be9c-68b0ecbb4549" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.780435] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c16018cb-b1d5-479e-be9c-68b0ecbb4549',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.894146] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4754c815-e215-49af-b64e-e52ebe2b915e in Status: SUCCESS [ 717.894146] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.894146] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.894146] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.894146] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.894146] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.894146] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.894146] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.894146] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.894146] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.894146] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.983290] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.282697] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.282978] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.283118] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.283417] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.283596] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.283728] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port c16018cb-b1d5-479e-be9c-68b0ecbb4549 not found, creating... [ 718.284065] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.284234] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.284348] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.284593] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.284755] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.285161] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.285348] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.285466] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.285675] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.285809] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.285946] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: c16018cb-b1d5-479e-be9c-68b0ecbb4549 is going to be created. [ 718.309425] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.309627] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.309876] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.310150] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.310406] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.310622] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-c16018cb-b1d5-479e-be9c-68b0ecbb4549" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.395885] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4754c815-e215-49af-b64e-e52ebe2b915e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.396130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.396191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.396397] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.396633] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.396728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.396779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.396964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.397043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.397101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.397272] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4754c815-e215-49af-b64e-e52ebe2b915e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.397345] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.397421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.397600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.397768] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.397870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.397931] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.398075] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.398156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.398243] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.398357] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.487256] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.513222] env[69343]: INFO networking_nsxv3.common.synchronization [req-ecc4271e-fb71-4d87-be9c-1d937fe2e758 req-303c1911-053c-46c8-8a72-cb60faf3da4a tempest-AttachInterfacesUnderV243Test-231606422 tempest-AttachInterfacesUnderV243Test-231606422-project-member] Enqueued Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_members [ 718.513222] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGHEST for action security_group_members [ 718.513222] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.513222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.900864] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4754c815-e215-49af-b64e-e52ebe2b915e: rpc.has_security_group_logging(os_id): False [ 718.924270] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.924414] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.924482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.924706] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.924844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.924983] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.925092] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.925149] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.925366] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.925440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.925637] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.926824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.926824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.926824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.927605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.928445] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.928445] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.928445] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.928445] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.928445] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.928733] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4754c815-e215-49af-b64e-e52ebe2b915e is going to be updated. [ 718.989806] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.990089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.990089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.990272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.990388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.990472] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 719.013358] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.013536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.013650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.013998] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.014271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.034154] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4754c815-e215-49af-b64e-e52ebe2b915e in Status: IN_PROGRESS for 2s [ 719.107854] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.108262] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.110054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.110054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.110054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.133000] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 719.294692] env[69343]: INFO networking_nsxv3.common.synchronization [req-1d1f1cb9-89d5-4d76-8f5d-4c33bfdb2ec0 req-19bec35c-b008-4bbf-a6ff-8940f5fb069b service nova] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_rules [ 719.294692] env[69343]: INFO networking_nsxv3.common.synchronization [req-1d1f1cb9-89d5-4d76-8f5d-4c33bfdb2ec0 req-19bec35c-b008-4bbf-a6ff-8940f5fb069b service nova] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 719.295355] env[69343]: INFO networking_nsxv3.common.synchronization [req-1d1f1cb9-89d5-4d76-8f5d-4c33bfdb2ec0 req-19bec35c-b008-4bbf-a6ff-8940f5fb069b service nova] Enqueued Resource ID: c16018cb-b1d5-479e-be9c-68b0ecbb4549 with Priority: HIGHEST for action port [ 719.296156] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_rules [ 719.296830] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 719.298387] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c16018cb-b1d5-479e-be9c-68b0ecbb4549 with Priority: HIGHEST for action port [ 719.298387] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.298387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.298387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.298387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.298387] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.302022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.302022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.302022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.302022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.302022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.302022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.302022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.302022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.302022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.302022] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.302022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-c16018cb-b1d5-479e-be9c-68b0ecbb4549 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.302022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c16018cb-b1d5-479e-be9c-68b0ecbb4549" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.302022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c16018cb-b1d5-479e-be9c-68b0ecbb4549" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.302022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c16018cb-b1d5-479e-be9c-68b0ecbb4549" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.302022] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c16018cb-b1d5-479e-be9c-68b0ecbb4549',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.312399] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: SUCCESS [ 719.312671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.313147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.313346] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.313536] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.313651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.313723] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.313875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.313954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.314120] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.314248] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.314971] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.315300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.315483] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.315638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.315711] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.315864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.315943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.316049] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.554072] env[69343]: INFO networking_nsxv3.common.synchronization [None req-7cb23fdc-c3e0-4232-8409-776c96f079cf None None] Enqueued Resource ID: 6054aa73-7141-4796-8983-b9c7d63f4820 with Priority: HIGHEST for action port [ 719.554642] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6054aa73-7141-4796-8983-b9c7d63f4820 with Priority: HIGHEST for action port [ 719.554954] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-6054aa73-7141-4796-8983-b9c7d63f4820 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.555101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6054aa73-7141-4796-8983-b9c7d63f4820" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.555162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6054aa73-7141-4796-8983-b9c7d63f4820" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.555742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6054aa73-7141-4796-8983-b9c7d63f4820" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.555742] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6054aa73-7141-4796-8983-b9c7d63f4820',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.804832] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.804832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.809135] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.809135] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c16018cb-b1d5-479e-be9c-68b0ecbb4549 with status ACTIVE [ 719.809135] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.809135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.809135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.809135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.809135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.809135] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.809135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.809135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.809135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.809135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.809980] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.810286] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.812516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.812516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.812516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.812516] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c16018cb-b1d5-479e-be9c-68b0ecbb4549 is going to be updated. [ 719.819267] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.819267] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.819267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.825433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.825433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.825433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.825433] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.825433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.825433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.825433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.825433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.825433] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 is going to be updated. [ 719.834037] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.834874] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.835106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.836280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.836280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.836280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c16018cb-b1d5-479e-be9c-68b0ecbb4549" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.857820] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.857820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.857820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.857820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.857820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.869619] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: IN_PROGRESS for 2s [ 720.061040] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6054aa73-7141-4796-8983-b9c7d63f4820 [ 720.061040] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.061040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.061040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.061040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.061040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.061040] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6054aa73-7141-4796-8983-b9c7d63f4820 already deleted. [ 720.061040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6054aa73-7141-4796-8983-b9c7d63f4820" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.313662] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.327102] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c52eea06-29db-49da-b0fb-ebb6ba4a8d86: rpc.has_security_group_logging(os_id): False [ 720.348909] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.352404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.352473] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.352739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.353081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.353187] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.353325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.353393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.353564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.353657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.353747] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 is going to be updated. [ 720.437909] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.437909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.437909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.438120] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.438271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.459210] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: IN_PROGRESS for 2s [ 720.467616] env[69343]: INFO networking_nsxv3.common.synchronization [None req-ce26ca9a-dd3c-47fe-9aa8-436ccd9ead41 tempest-MigrationsAdminTest-544745941 tempest-MigrationsAdminTest-544745941-project-member] Enqueued Resource ID: d1599ea5-1078-4015-9bcd-b3587f2d720f with Priority: HIGHEST for action security_group_rules [ 720.467616] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1599ea5-1078-4015-9bcd-b3587f2d720f with Priority: HIGHEST for action security_group_rules [ 720.467616] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1599ea5-1078-4015-9bcd-b3587f2d720f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.467616] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1599ea5-1078-4015-9bcd-b3587f2d720f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.467616] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1599ea5-1078-4015-9bcd-b3587f2d720f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.467616] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1599ea5-1078-4015-9bcd-b3587f2d720f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.467616] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1599ea5-1078-4015-9bcd-b3587f2d720f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.609040] env[69343]: INFO networking_nsxv3.common.synchronization [None req-2e6ae767-8951-4be3-a6a4-51bc0c467576 tempest-MigrationsAdminTest-544745941 tempest-MigrationsAdminTest-544745941-project-member] Enqueued Resource ID: d1599ea5-1078-4015-9bcd-b3587f2d720f with Priority: HIGHEST for action security_group_rules [ 720.609040] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1599ea5-1078-4015-9bcd-b3587f2d720f with Priority: HIGHEST for action security_group_rules [ 720.609040] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1599ea5-1078-4015-9bcd-b3587f2d720f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.609040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1599ea5-1078-4015-9bcd-b3587f2d720f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.818224] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.818397] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.818575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.819285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.819428] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.819500] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be created. [ 720.952376] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.953591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.953591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.953591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.953591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.964948] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: UNINITIALIZED for 2s [ 720.992053] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.992409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.992409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.992497] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.993596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.993596] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1599ea5-1078-4015-9bcd-b3587f2d720f already deleted. [ 720.993596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1599ea5-1078-4015-9bcd-b3587f2d720f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.993596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1599ea5-1078-4015-9bcd-b3587f2d720f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.993596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1599ea5-1078-4015-9bcd-b3587f2d720f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.993596] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1599ea5-1078-4015-9bcd-b3587f2d720f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.059864] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4754c815-e215-49af-b64e-e52ebe2b915e in Status: SUCCESS [ 721.059864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.155917] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 721.155917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.155917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.155917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.155917] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.155917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.155917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.155917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.155917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.155917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.155917] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.525917] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.526147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.526239] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.526773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.526773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.526773] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1599ea5-1078-4015-9bcd-b3587f2d720f already deleted. [ 721.526773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1599ea5-1078-4015-9bcd-b3587f2d720f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.658640] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.658907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.658907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.659124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.659302] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.659405] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.659472] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.659637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.659761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.659837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.660015] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.660084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.660146] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.660289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.660427] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.660501] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.660553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.660709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.660831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.660965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.661093] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.882759] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: SUCCESS [ 721.882989] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 deletion is rescheduled due to dependency. [ 721.883767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.165218] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47b39a17-6794-4f6b-b042-45a1e062090b: rpc.has_security_group_logging(os_id): False [ 722.208204] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.209405] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.209535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.210431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.211160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.214029] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.214220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.214604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.214604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.214604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.214922] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.215482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.215482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.215482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.215910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.216191] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.217035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.217035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.217035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.217035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.217035] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 722.239449] env[69343]: INFO networking_nsxv3.common.synchronization [None req-24e043a3-7a88-4448-9588-f287777e47af None None] Enqueued Resource ID: 96e2ca68-7456-4c8b-8c6d-9f026f23b243 with Priority: HIGHEST for action port [ 722.239772] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96e2ca68-7456-4c8b-8c6d-9f026f23b243 with Priority: HIGHEST for action port [ 722.240425] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-96e2ca68-7456-4c8b-8c6d-9f026f23b243 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.240597] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96e2ca68-7456-4c8b-8c6d-9f026f23b243" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.240597] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96e2ca68-7456-4c8b-8c6d-9f026f23b243" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.241420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96e2ca68-7456-4c8b-8c6d-9f026f23b243" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.241420] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96e2ca68-7456-4c8b-8c6d-9f026f23b243',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.309686] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.309686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.309686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.309686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.309686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.332382] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 722.476936] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 in Status: SUCCESS [ 722.479213] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.744266] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96e2ca68-7456-4c8b-8c6d-9f026f23b243 [ 722.745061] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.746070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.746070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.746070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.746070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.746070] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96e2ca68-7456-4c8b-8c6d-9f026f23b243 already deleted. [ 722.746070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96e2ca68-7456-4c8b-8c6d-9f026f23b243" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.746855] env[69343]: INFO networking_nsxv3.common.synchronization [req-67db19d2-eda0-4416-8b1b-5171fba765c7 req-91f75c32-8645-493a-b3b1-7e1af2f9afa6 tempest-ServersTestManualDisk-1820487143 tempest-ServersTestManualDisk-1820487143-project-member] Enqueued Resource ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 with Priority: HIGHEST for action security_group_members [ 722.747455] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 with Priority: HIGHEST for action security_group_members [ 722.747785] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-44259464-12d7-4ca0-9bd3-7620c5aac9c5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.747948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.748044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.748286] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.748447] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.748549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.748614] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.748760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.749023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.749447] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44259464-12d7-4ca0-9bd3-7620c5aac9c5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.973857] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 722.975878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.975878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.975878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.975878] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.975878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.975878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.975878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.975878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.975878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.975878] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.080609] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.080857] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-806" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.080986] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-806" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.081364] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-806" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.081730] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.081830] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.081992] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.082556] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.082728] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.082929] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.083058] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.083169] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.083279] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.083390] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.083531] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.083678] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.103613] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.103613] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 723.103865] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.103865] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-806" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.104158] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-94e7b9cc-d113-472e-a265-9ba458594a2b taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.104355] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-94e7b9cc-d113-472e-a265-9ba458594a2b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.104444] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-94e7b9cc-d113-472e-a265-9ba458594a2b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.104777] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-94e7b9cc-d113-472e-a265-9ba458594a2b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.104919] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94e7b9cc-d113-472e-a265-9ba458594a2b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.251794] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.252094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.252094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.252251] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.252342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.252539] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.252659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.252690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.252835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.252945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.253042] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 already deleted. [ 723.253130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.480744] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.480943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.481037] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.481231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.481405] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.481504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.481569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.481727] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.481825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.481915] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.482072] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.482163] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.482228] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.482372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.482505] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.482627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.482690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.482828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.482933] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.482976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.483073] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.607861] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.608163] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.608303] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.608758] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.608894] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.609109] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 94e7b9cc-d113-472e-a265-9ba458594a2b not found, creating... [ 723.609432] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.609610] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.610571] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.610571] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.610571] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.610571] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.610571] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.610860] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.610860] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.611981] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.611981] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 94e7b9cc-d113-472e-a265-9ba458594a2b is going to be created. [ 723.637033] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.637276] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.639156] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.639156] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.639156] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.639156] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-94e7b9cc-d113-472e-a265-9ba458594a2b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.987360] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40a389c1-84ea-4a8d-9f0b-0df3c555e73b: rpc.has_security_group_logging(os_id): False [ 724.008027] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.008181] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.008181] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.008420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.008515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.008744] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.008869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.008921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.009100] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.009215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.009320] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.009406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.009459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.009595] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.009661] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.010189] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.010189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.010409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.010409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.010506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.010587] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be created. [ 724.103694] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.103913] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.103998] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.104241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.105031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.119221] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 724.349709] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 724.350088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.352721] env[69343]: INFO networking_nsxv3.common.synchronization [req-67db19d2-eda0-4416-8b1b-5171fba765c7 req-cd6a92ca-3b3a-4368-a607-b4d30ffd5e90 service nova] Enqueued Resource ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 with Priority: HIGHEST for action security_group_rules [ 724.352971] env[69343]: INFO networking_nsxv3.common.synchronization [req-67db19d2-eda0-4416-8b1b-5171fba765c7 req-cd6a92ca-3b3a-4368-a607-b4d30ffd5e90 service nova] Enqueued Resource ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 with Priority: HIGHEST for action security_group_members [ 724.353192] env[69343]: INFO networking_nsxv3.common.synchronization [req-67db19d2-eda0-4416-8b1b-5171fba765c7 req-cd6a92ca-3b3a-4368-a607-b4d30ffd5e90 service nova] Enqueued Resource ID: 94e7b9cc-d113-472e-a265-9ba458594a2b with Priority: HIGHEST for action port [ 724.353868] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 with Priority: HIGHEST for action security_group_rules [ 724.354034] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 with Priority: HIGHEST for action security_group_members [ 724.354214] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94e7b9cc-d113-472e-a265-9ba458594a2b with Priority: HIGHEST for action port [ 724.354537] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.355793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.355793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.355793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.355793] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44259464-12d7-4ca0-9bd3-7620c5aac9c5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.356870] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-44259464-12d7-4ca0-9bd3-7620c5aac9c5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.357045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.357121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.357370] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.357704] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.357704] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.357882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.357948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.358081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.358227] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44259464-12d7-4ca0-9bd3-7620c5aac9c5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.359906] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-94e7b9cc-d113-472e-a265-9ba458594a2b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.360058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94e7b9cc-d113-472e-a265-9ba458594a2b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.360126] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94e7b9cc-d113-472e-a265-9ba458594a2b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.360295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94e7b9cc-d113-472e-a265-9ba458594a2b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.360373] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94e7b9cc-d113-472e-a265-9ba458594a2b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.862513] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94e7b9cc-d113-472e-a265-9ba458594a2b with status ACTIVE [ 724.863853] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.863853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.863853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.863853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.863853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.863853] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.863853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.863853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.864454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.864615] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.864874] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.865139] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.865283] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.865557] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.867019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.867019] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94e7b9cc-d113-472e-a265-9ba458594a2b is going to be updated. [ 724.869914] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-44259464-12d7-4ca0-9bd3-7620c5aac9c5 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.869914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.869914] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44259464-12d7-4ca0-9bd3-7620c5aac9c5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.890150] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.890305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.890389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.890621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.890793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.891010] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94e7b9cc-d113-472e-a265-9ba458594a2b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.370576] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44259464-12d7-4ca0-9bd3-7620c5aac9c5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.873390] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.873619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.873661] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.873851] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.874111] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.874247] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 is going to be created. [ 725.900174] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.900393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.900393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.900572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.900772] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.918880] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 in Status: UNINITIALIZED for 2s [ 726.133618] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 726.135116] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.849636] env[69343]: INFO networking_nsxv3.common.synchronization [req-f9685cb8-7685-4ff2-a385-fe3b82d0fad2 req-fd529de0-e2a0-421c-bd90-7999de08856a tempest-ServerTagsTestJSON-531325346 tempest-ServerTagsTestJSON-531325346-project-member] Enqueued Resource ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c with Priority: HIGHEST for action security_group_members [ 727.850273] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c with Priority: HIGHEST for action security_group_members [ 727.853068] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.853305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.853372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.853595] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.853831] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.853954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.854157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.854277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.854277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.854386] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.934282] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 in Status: SUCCESS [ 727.934621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.934961] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.935290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.935602] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.935856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.936012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.936246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.936436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.937077] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.937279] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44259464-12d7-4ca0-9bd3-7620c5aac9c5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.045103] env[69343]: INFO networking_nsxv3.common.synchronization [req-28c676c1-3b2f-4483-b727-fa47d4a2983f req-3c501b76-8d04-456e-8266-dc86d225fd08 tempest-DeleteServersAdminTestJSON-2146523094 tempest-DeleteServersAdminTestJSON-2146523094-project-member] Enqueued Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGHEST for action security_group_members [ 728.046366] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGHEST for action security_group_members [ 728.046366] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4754c815-e215-49af-b64e-e52ebe2b915e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.046366] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.049173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.049173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.049173] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.049173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.049173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.049173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.049173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.049173] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.361192] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.361370] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.361430] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.361656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.361759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.362215] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.362215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.362215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.362737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.362737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.362737] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c is going to be updated. [ 728.400028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.400028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.400028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.400028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.400028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.410642] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c in Status: IN_PROGRESS for 2s [ 728.440235] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44259464-12d7-4ca0-9bd3-7620c5aac9c5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.551081] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.551081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.551398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.551398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.551548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.551851] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.551963] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.552036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.552304] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.552450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.552556] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4754c815-e215-49af-b64e-e52ebe2b915e is going to be updated. [ 728.583316] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.583530] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.583530] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.583833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.584068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.597077] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4754c815-e215-49af-b64e-e52ebe2b915e in Status: IN_PROGRESS for 2s [ 728.943586] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44259464-12d7-4ca0-9bd3-7620c5aac9c5: rpc.has_security_group_logging(os_id): False [ 728.965447] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.965618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.965660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.965874] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.965971] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.966375] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.966501] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.966501] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.966771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.966771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.966841] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 is going to be created. [ 729.088757] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.089127] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.089634] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.089851] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.090541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.113814] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 in Status: IN_PROGRESS for 2s [ 729.394703] env[69343]: INFO networking_nsxv3.common.synchronization [req-3d0b2dc7-1e85-4262-87bb-1ef575f9567d req-0c6f871e-4f1b-4264-b9e8-26405d0886fd tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 with Priority: HIGHEST for action security_group_members [ 729.394951] env[69343]: INFO networking_nsxv3.common.synchronization [req-3d0b2dc7-1e85-4262-87bb-1ef575f9567d req-0c6f871e-4f1b-4264-b9e8-26405d0886fd tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 729.395717] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 with Priority: HIGHEST for action security_group_members [ 729.395717] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 729.395856] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.396045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.396045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.396267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.396437] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.396528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.396580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.396752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.396823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.396891] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.397834] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.398027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.398027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.398144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.398279] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.398673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.398673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.398673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.398673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.398673] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.530651] env[69343]: INFO networking_nsxv3.common.synchronization [req-3d0b2dc7-1e85-4262-87bb-1ef575f9567d req-0c6f871e-4f1b-4264-b9e8-26405d0886fd tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_rules [ 729.530898] env[69343]: INFO networking_nsxv3.common.synchronization [req-3d0b2dc7-1e85-4262-87bb-1ef575f9567d req-0c6f871e-4f1b-4264-b9e8-26405d0886fd tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 729.531144] env[69343]: INFO networking_nsxv3.common.synchronization [req-3d0b2dc7-1e85-4262-87bb-1ef575f9567d req-0c6f871e-4f1b-4264-b9e8-26405d0886fd tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 with Priority: HIGHEST for action security_group_rules [ 729.531306] env[69343]: INFO networking_nsxv3.common.synchronization [req-3d0b2dc7-1e85-4262-87bb-1ef575f9567d req-0c6f871e-4f1b-4264-b9e8-26405d0886fd tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 with Priority: HIGHEST for action security_group_members [ 729.531473] env[69343]: INFO networking_nsxv3.common.synchronization [req-3d0b2dc7-1e85-4262-87bb-1ef575f9567d req-0c6f871e-4f1b-4264-b9e8-26405d0886fd tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: c16018cb-b1d5-479e-be9c-68b0ecbb4549 with Priority: HIGHEST for action port [ 729.532464] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_rules [ 729.532635] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 with Priority: HIGHEST for action security_group_rules [ 729.532820] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c16018cb-b1d5-479e-be9c-68b0ecbb4549 with Priority: HIGHEST for action port [ 729.532983] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 729.533149] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 with Priority: HIGHEST for action security_group_members [ 729.533509] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.533596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.533662] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.533912] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.534048] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.535227] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.535352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.535923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.535923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.535923] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.538783] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-c16018cb-b1d5-479e-be9c-68b0ecbb4549 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.538941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c16018cb-b1d5-479e-be9c-68b0ecbb4549" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.539117] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c16018cb-b1d5-479e-be9c-68b0ecbb4549" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.539333] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c16018cb-b1d5-479e-be9c-68b0ecbb4549" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.539450] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c16018cb-b1d5-479e-be9c-68b0ecbb4549',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.540469] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.540589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.540892] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.541039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.900848] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.907891] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.042583] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c16018cb-b1d5-479e-be9c-68b0ecbb4549 with status ACTIVE [ 730.042831] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.042957] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.043045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.043268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.043364] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.043557] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.043659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.043723] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.043865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.043981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.044139] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.044245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.044321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.044443] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.044657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.044657] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c16018cb-b1d5-479e-be9c-68b0ecbb4549 is going to be updated. [ 730.046217] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.046217] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.046337] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.046570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.072378] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.072378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.072378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.072378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.072378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.072378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c16018cb-b1d5-479e-be9c-68b0ecbb4549" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.137227] env[69343]: INFO networking_nsxv3.common.synchronization [req-ac1242af-36d9-4f79-addd-49d5e962ed8a req-304fb76e-2c68-4121-b214-d04bf3bfaf7b tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f with Priority: HIGHEST for action security_group_members [ 730.137523] env[69343]: INFO networking_nsxv3.common.synchronization [req-ac1242af-36d9-4f79-addd-49d5e962ed8a req-304fb76e-2c68-4121-b214-d04bf3bfaf7b tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 with Priority: HIGHEST for action security_group_members [ 730.137736] env[69343]: INFO networking_nsxv3.common.synchronization [req-ac1242af-36d9-4f79-addd-49d5e962ed8a req-304fb76e-2c68-4121-b214-d04bf3bfaf7b tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 730.138662] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f with Priority: HIGHEST for action security_group_members [ 730.138875] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 with Priority: HIGHEST for action security_group_members [ 730.139050] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 730.139454] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4923a56f-6f82-4449-82ab-38fbf0c7542f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.139652] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.139760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.140427] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.140427] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.140575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.140618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.140870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.141008] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.141568] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4923a56f-6f82-4449-82ab-38fbf0c7542f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.143108] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.143241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.143595] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.143887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.206781] env[69343]: INFO networking_nsxv3.common.synchronization [req-ac1242af-36d9-4f79-addd-49d5e962ed8a req-304fb76e-2c68-4121-b214-d04bf3bfaf7b tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_rules [ 730.207055] env[69343]: INFO networking_nsxv3.common.synchronization [req-ac1242af-36d9-4f79-addd-49d5e962ed8a req-304fb76e-2c68-4121-b214-d04bf3bfaf7b tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 730.207525] env[69343]: INFO networking_nsxv3.common.synchronization [req-ac1242af-36d9-4f79-addd-49d5e962ed8a req-304fb76e-2c68-4121-b214-d04bf3bfaf7b tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 with Priority: HIGHEST for action security_group_rules [ 730.207738] env[69343]: INFO networking_nsxv3.common.synchronization [req-ac1242af-36d9-4f79-addd-49d5e962ed8a req-304fb76e-2c68-4121-b214-d04bf3bfaf7b tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 with Priority: HIGHEST for action security_group_members [ 730.207899] env[69343]: INFO networking_nsxv3.common.synchronization [req-ac1242af-36d9-4f79-addd-49d5e962ed8a req-304fb76e-2c68-4121-b214-d04bf3bfaf7b tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f with Priority: HIGHEST for action security_group_rules [ 730.208169] env[69343]: INFO networking_nsxv3.common.synchronization [req-ac1242af-36d9-4f79-addd-49d5e962ed8a req-304fb76e-2c68-4121-b214-d04bf3bfaf7b tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f with Priority: HIGHEST for action security_group_members [ 730.208343] env[69343]: INFO networking_nsxv3.common.synchronization [req-ac1242af-36d9-4f79-addd-49d5e962ed8a req-304fb76e-2c68-4121-b214-d04bf3bfaf7b tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: c16018cb-b1d5-479e-be9c-68b0ecbb4549 with Priority: HIGHEST for action port [ 730.209113] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_rules [ 730.209198] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 with Priority: HIGHEST for action security_group_rules [ 730.209306] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f with Priority: HIGHEST for action security_group_members [ 730.209409] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c16018cb-b1d5-479e-be9c-68b0ecbb4549 with Priority: HIGHEST for action port [ 730.209502] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f with Priority: HIGHEST for action security_group_rules [ 730.209594] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 730.209695] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 with Priority: HIGHEST for action security_group_members [ 730.211182] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.211362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.211901] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.211901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.212299] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4923a56f-6f82-4449-82ab-38fbf0c7542f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.212375] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.212609] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-c16018cb-b1d5-479e-be9c-68b0ecbb4549 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.212780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c16018cb-b1d5-479e-be9c-68b0ecbb4549" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.212933] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c16018cb-b1d5-479e-be9c-68b0ecbb4549" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.213226] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c16018cb-b1d5-479e-be9c-68b0ecbb4549" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.213356] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c16018cb-b1d5-479e-be9c-68b0ecbb4549',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.214635] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4923a56f-6f82-4449-82ab-38fbf0c7542f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.214805] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.214905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.215292] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.215423] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4923a56f-6f82-4449-82ab-38fbf0c7542f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.216553] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.216687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.216969] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.217122] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.405045] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.410556] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.421636] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c in Status: SUCCESS [ 730.421825] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c deletion is rescheduled due to dependency. [ 730.421952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.607419] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4754c815-e215-49af-b64e-e52ebe2b915e in Status: SUCCESS [ 730.607607] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4754c815-e215-49af-b64e-e52ebe2b915e deletion is rescheduled due to dependency. [ 730.607884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.645950] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4923a56f-6f82-4449-82ab-38fbf0c7542f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.718223] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4923a56f-6f82-4449-82ab-38fbf0c7542f taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.718521] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.718733] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c16018cb-b1d5-479e-be9c-68b0ecbb4549 with status ACTIVE [ 730.718793] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.718887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.718948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.719231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.719748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.719748] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.719748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.719748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.720100] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.720100] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.720285] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.720973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.720973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.720973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.720973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.720973] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c16018cb-b1d5-479e-be9c-68b0ecbb4549 is going to be updated. [ 730.750114] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.750314] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.750399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.750612] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.750759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.750940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c16018cb-b1d5-479e-be9c-68b0ecbb4549" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.985444] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.985444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.985444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.985444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.985444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.985444] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 is going to be created. [ 730.985444] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.985444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.985444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.985444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.985444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.985444] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 730.985444] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.985444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.985444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.986960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.986960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.986960] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 in Status: UNINITIALIZED for 2s [ 730.986960] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.986960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.986960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.986960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.986960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.986960] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 731.129172] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 in Status: SUCCESS [ 731.129538] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.151191] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4923a56f-6f82-4449-82ab-38fbf0c7542f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.656695] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.656695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.656695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.656695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.656695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.656695] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f is going to be created. [ 731.709870] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.709870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.709870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.709870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.709870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.722935] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f in Status: UNINITIALIZED for 2s [ 732.547786] env[69343]: INFO networking_nsxv3.common.synchronization [req-23f817f6-0fd2-4c2c-b52c-509a92923a85 req-0487970c-c49b-49f2-8c9f-7aad440d755d tempest-ServerActionsTestOtherA-678333832 tempest-ServerActionsTestOtherA-678333832-project-member] Enqueued Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_members [ 732.547786] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_members [ 732.549789] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.549949] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.550040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.550313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.550517] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.550613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.550664] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.550798] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.550971] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.551123] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.974628] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 in Status: SUCCESS [ 732.974879] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.975086] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.975361] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.975479] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.975596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.975670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.977063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.977063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.977063] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.995307] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 732.995567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.995721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.995977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.996188] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.996306] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.996369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.996527] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.996607] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.996707] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.055852] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.056052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.056139] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.056374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.056547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.056783] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.056897] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.056965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.057156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.057261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.057362] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc already deleted. [ 733.057458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.472912] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-184 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.473409] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.473980] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.474843] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.476141] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.476141] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.476141] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.476690] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.476690] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.476796] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.476860] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.476936] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.477058] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.477216] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.477324] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.477473] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.483020] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.501174] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.518907] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.519173] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 733.519425] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.519514] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.519837] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-73c488d0-c035-405c-aa2b-c19401bfb69e taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.520057] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-73c488d0-c035-405c-aa2b-c19401bfb69e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.520180] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-73c488d0-c035-405c-aa2b-c19401bfb69e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.521298] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-73c488d0-c035-405c-aa2b-c19401bfb69e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.521519] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73c488d0-c035-405c-aa2b-c19401bfb69e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.734888] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f in Status: SUCCESS [ 733.735147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.735147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.737408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.737408] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.737408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.737408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.737408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.737408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.737408] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4923a56f-6f82-4449-82ab-38fbf0c7542f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.861975] env[69343]: INFO networking_nsxv3.common.synchronization [None req-85a7f1c1-5c88-4a45-9cb6-8f9866fed610 None None] Enqueued Resource ID: 73a089f3-8b0c-419f-b880-33d2ecc393eb with Priority: HIGHEST for action port [ 733.866137] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73a089f3-8b0c-419f-b880-33d2ecc393eb with Priority: HIGHEST for action port [ 733.866137] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-73a089f3-8b0c-419f-b880-33d2ecc393eb taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.866137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73a089f3-8b0c-419f-b880-33d2ecc393eb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.866137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73a089f3-8b0c-419f-b880-33d2ecc393eb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.866137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73a089f3-8b0c-419f-b880-33d2ecc393eb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.866137] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73a089f3-8b0c-419f-b880-33d2ecc393eb',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.985810] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.006644] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.027023] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.027023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.027023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.027023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.027023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.027023] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 73c488d0-c035-405c-aa2b-c19401bfb69e not found, creating... [ 734.027023] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.027023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.027023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.027023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.027023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.027514] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.027910] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.028242] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.028579] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.028828] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.029089] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 73c488d0-c035-405c-aa2b-c19401bfb69e is going to be created. [ 734.051632] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.055281] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.055281] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.055281] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.055281] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.055281] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-73c488d0-c035-405c-aa2b-c19401bfb69e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.242060] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4923a56f-6f82-4449-82ab-38fbf0c7542f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.369907] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73a089f3-8b0c-419f-b880-33d2ecc393eb [ 734.370206] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.370353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.370429] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.370648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.370739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.370842] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73a089f3-8b0c-419f-b880-33d2ecc393eb already deleted. [ 734.370922] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73a089f3-8b0c-419f-b880-33d2ecc393eb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.487683] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.491482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.491482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.491482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.491482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.491482] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 is going to be updated. [ 734.507324] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.508024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.508024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.508267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.508446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.510929] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 734.523945] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.524110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.524184] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.524470] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.524558] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.534724] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 in Status: IN_PROGRESS for 2s [ 734.552513] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.552513] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.552513] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.552513] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.552513] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.563311] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 734.667184] env[69343]: INFO networking_nsxv3.common.synchronization [None req-74fdd10c-0600-4bed-a0bf-011680511603 tempest-ServersTestFqdnHostnames-412725694 tempest-ServersTestFqdnHostnames-412725694-project-member] Enqueued Resource ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f with Priority: HIGHEST for action security_group_rules [ 734.668195] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f with Priority: HIGHEST for action security_group_rules [ 734.668763] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1f09c79-4735-45a5-8af5-ec47fcc9b65f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.668945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.669063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.669410] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.669484] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1f09c79-4735-45a5-8af5-ec47fcc9b65f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.743078] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4923a56f-6f82-4449-82ab-38fbf0c7542f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.760614] env[69343]: INFO networking_nsxv3.common.synchronization [None req-a4d5f372-63d0-4b1c-8218-66511a0d8dce tempest-ServersTestFqdnHostnames-412725694 tempest-ServersTestFqdnHostnames-412725694-project-member] Enqueued Resource ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f with Priority: HIGHEST for action security_group_rules [ 734.761421] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f with Priority: HIGHEST for action security_group_rules [ 734.761764] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1f09c79-4735-45a5-8af5-ec47fcc9b65f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.764988] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.027036] env[69343]: INFO networking_nsxv3.common.synchronization [req-85376e14-9602-4c1e-bf66-d67f30bd27e1 req-b520f5c4-060d-4aed-be45-242c39cf8697 tempest-ServerDiskConfigTestJSON-1018188129 tempest-ServerDiskConfigTestJSON-1018188129-project-member] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 735.027850] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 735.028335] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.028526] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.028655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.029068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.029341] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.029458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.029541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.029763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.029928] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.032886] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.190319] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.191386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.192182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.192298] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.192879] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.192879] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f already deleted. [ 735.192879] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.192879] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.193142] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.193142] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1f09c79-4735-45a5-8af5-ec47fcc9b65f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.245891] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.246063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.246135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.246433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.246563] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.246667] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f is going to be updated. [ 735.277040] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.277190] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.277261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.277473] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.277619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.288681] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f in Status: IN_PROGRESS for 2s [ 735.403484] env[69343]: INFO networking_nsxv3.common.synchronization [req-23f817f6-0fd2-4c2c-b52c-509a92923a85 req-78207e7b-617e-4095-977d-a2bfa9b97548 service nova] Enqueued Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_rules [ 735.403662] env[69343]: INFO networking_nsxv3.common.synchronization [req-23f817f6-0fd2-4c2c-b52c-509a92923a85 req-78207e7b-617e-4095-977d-a2bfa9b97548 service nova] Enqueued Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_members [ 735.403796] env[69343]: INFO networking_nsxv3.common.synchronization [req-23f817f6-0fd2-4c2c-b52c-509a92923a85 req-78207e7b-617e-4095-977d-a2bfa9b97548 service nova] Enqueued Resource ID: 73c488d0-c035-405c-aa2b-c19401bfb69e with Priority: HIGHEST for action port [ 735.404527] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_rules [ 735.404527] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_members [ 735.404621] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73c488d0-c035-405c-aa2b-c19401bfb69e with Priority: HIGHEST for action port [ 735.404841] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.408189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.408189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.408189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.408189] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.408189] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.408189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.408189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.408189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.408189] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.408189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.408189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.408189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.408189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.408189] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.409471] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-73c488d0-c035-405c-aa2b-c19401bfb69e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.409471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73c488d0-c035-405c-aa2b-c19401bfb69e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.409471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73c488d0-c035-405c-aa2b-c19401bfb69e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.409471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73c488d0-c035-405c-aa2b-c19401bfb69e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.409471] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73c488d0-c035-405c-aa2b-c19401bfb69e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.534752] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.534905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.534976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.535216] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.535306] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.536517] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.536517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.536517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.536517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.536517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.536517] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b already deleted. [ 735.536517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.712419] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.712664] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.712664] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.712832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.712922] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.713031] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f already deleted. [ 735.713385] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.913790] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.914862] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.915043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.915144] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73c488d0-c035-405c-aa2b-c19401bfb69e with status ACTIVE [ 735.915297] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.915441] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.915498] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.915658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.915746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.915997] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.915997] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.916153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.916355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.916355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.916463] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.916555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.916603] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.916732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.916808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.916926] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73c488d0-c035-405c-aa2b-c19401bfb69e is going to be updated. [ 735.939685] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.939872] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.939872] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.940015] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.940158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.940332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73c488d0-c035-405c-aa2b-c19401bfb69e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.205055] env[69343]: INFO networking_nsxv3.common.synchronization [None req-0f5336d1-15e2-467b-9c7e-612089c7cf86 None None] Enqueued Resource ID: b15d801f-0f3e-48ec-b8df-36fbbce8d18c with Priority: HIGHEST for action port [ 736.205530] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b15d801f-0f3e-48ec-b8df-36fbbce8d18c with Priority: HIGHEST for action port [ 736.206218] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-b15d801f-0f3e-48ec-b8df-36fbbce8d18c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.206218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b15d801f-0f3e-48ec-b8df-36fbbce8d18c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.206746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b15d801f-0f3e-48ec-b8df-36fbbce8d18c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.207095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b15d801f-0f3e-48ec-b8df-36fbbce8d18c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.207224] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b15d801f-0f3e-48ec-b8df-36fbbce8d18c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.249000] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.249239] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.249363] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.249704] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.249985] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.250821] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.250968] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.251292] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.251370] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.251600] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.251784] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.251930] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.252107] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.252271] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.252395] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.252550] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.271909] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.271909] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 736.271909] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.271909] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.272507] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-4deefdac-3184-47b5-9d60-451abcbbb628 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.273026] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-4deefdac-3184-47b5-9d60-451abcbbb628" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.273026] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-4deefdac-3184-47b5-9d60-451abcbbb628" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.273407] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-4deefdac-3184-47b5-9d60-451abcbbb628" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.275095] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4deefdac-3184-47b5-9d60-451abcbbb628',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.419081] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.550692] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 in Status: SUCCESS [ 736.551196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.551467] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.551739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.552034] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.552227] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.552309] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.552552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.552662] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.552789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.552921] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.553951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.554170] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.554389] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.554504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.554568] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.554713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.554796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.554919] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.575396] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 4s [ 736.711016] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b15d801f-0f3e-48ec-b8df-36fbbce8d18c [ 736.711462] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.711462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.711462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.711690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.711783] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.711912] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b15d801f-0f3e-48ec-b8df-36fbbce8d18c already deleted. [ 736.712011] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b15d801f-0f3e-48ec-b8df-36fbbce8d18c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.778859] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.778859] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.778859] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.779141] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.779308] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.779466] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 4deefdac-3184-47b5-9d60-451abcbbb628 not found, creating... [ 736.779761] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.779983] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.780128] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.780360] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.780498] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.780794] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.780945] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.781156] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.781382] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.781515] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.781680] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 4deefdac-3184-47b5-9d60-451abcbbb628 is going to be created. [ 736.807987] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.808232] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.808359] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.808737] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.808873] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.809122] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-4deefdac-3184-47b5-9d60-451abcbbb628" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.923073] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.923073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.923525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.923525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.923525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.923653] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc is going to be created. [ 736.955411] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.955551] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.955628] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.955848] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.956016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.972411] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: UNINITIALIZED for 2s [ 737.057681] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.061216] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.301184] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f in Status: SUCCESS [ 737.301407] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.301619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.301866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.302121] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.302312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.302378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.302541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.302663] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.302761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.302851] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4923a56f-6f82-4449-82ab-38fbf0c7542f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.499965] env[69343]: INFO networking_nsxv3.common.synchronization [req-98625841-b85d-445c-a939-77beec9e7a27 req-2ea9e7f7-df81-46e4-a491-82207f703962 tempest-ListImageFiltersTestJSON-216247362 tempest-ListImageFiltersTestJSON-216247362-project-member] Enqueued Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGHEST for action security_group_members [ 737.499965] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGHEST for action security_group_members [ 737.499965] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-992f0e18-2006-4c90-ae32-07de7a98af22 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.499965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.499965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.499965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.499965] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.499965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.499965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.499965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.499965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.499965] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.560265] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3: rpc.has_security_group_logging(os_id): False [ 737.563520] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.582588] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.582720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.582798] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.583025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.583122] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.583360] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.583466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.584536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.584762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.584894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.585031] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 is going to be created. [ 737.675620] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.675841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.675841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.676192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.676415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.695093] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 in Status: IN_PROGRESS for 2s [ 737.805604] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4923a56f-6f82-4449-82ab-38fbf0c7542f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.880154] env[69343]: INFO networking_nsxv3.common.synchronization [req-85376e14-9602-4c1e-bf66-d67f30bd27e1 req-2a55585a-bec7-4e4f-a3ad-258f46097026 service nova] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_rules [ 737.880154] env[69343]: INFO networking_nsxv3.common.synchronization [req-85376e14-9602-4c1e-bf66-d67f30bd27e1 req-2a55585a-bec7-4e4f-a3ad-258f46097026 service nova] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 737.880154] env[69343]: INFO networking_nsxv3.common.synchronization [req-85376e14-9602-4c1e-bf66-d67f30bd27e1 req-2a55585a-bec7-4e4f-a3ad-258f46097026 service nova] Enqueued Resource ID: 4deefdac-3184-47b5-9d60-451abcbbb628 with Priority: HIGHEST for action port [ 737.880154] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_rules [ 737.880154] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 737.880154] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4deefdac-3184-47b5-9d60-451abcbbb628 with Priority: HIGHEST for action port [ 737.880154] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.880154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.880154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.880154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.880154] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.884019] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.884019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.884019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.884019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.884019] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.884019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.884019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.884019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.884019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.884019] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.884019] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-4deefdac-3184-47b5-9d60-451abcbbb628 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.884019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4deefdac-3184-47b5-9d60-451abcbbb628" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.884019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4deefdac-3184-47b5-9d60-451abcbbb628" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.884019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4deefdac-3184-47b5-9d60-451abcbbb628" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.884019] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4deefdac-3184-47b5-9d60-451abcbbb628',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.949289] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.949574] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.949726] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.950060] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.950325] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.950485] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.950602] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.950824] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.951037] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.953342] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 737.953430] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.953510] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.953630] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.953747] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 737.953859] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.954062] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.977078] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.977078] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 737.977078] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.977078] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.977078] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.977078] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.977576] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.977576] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.977669] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.001960] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.002266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.002440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.002749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.002899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.003226] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.003394] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.003500] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.003760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.003898] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.004055] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 992f0e18-2006-4c90-ae32-07de7a98af22 already deleted. [ 738.004158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.066521] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.066689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.066773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.067040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.067305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.067305] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 is going to be updated. [ 738.098158] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.098158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.098158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.098158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.098158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.108610] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 in Status: IN_PROGRESS for 2s [ 738.308655] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4923a56f-6f82-4449-82ab-38fbf0c7542f: rpc.has_security_group_logging(os_id): False [ 738.329397] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.329607] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.329724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.330087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.330267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.330636] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.330822] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.330981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.331778] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.331868] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.331966] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f is going to be created. [ 738.387748] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.390493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.390493] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.390493] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4deefdac-3184-47b5-9d60-451abcbbb628 with status ACTIVE [ 738.390493] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.390493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.390493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.390493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.390493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.390493] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.390493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.390493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.391241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.391241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.391241] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.391241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.391241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.391241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.391241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.391241] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4deefdac-3184-47b5-9d60-451abcbbb628 is going to be updated. [ 738.406212] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.406212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.406212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.406491] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.406528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.418187] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f in Status: IN_PROGRESS for 2s [ 738.426134] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.426134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.426134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.426803] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.426803] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.426959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4deefdac-3184-47b5-9d60-451abcbbb628" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.484236] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.484521] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.485657] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.486659] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.486659] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.486659] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a not found, creating... [ 738.486659] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.486659] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.487018] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.487018] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.487119] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.487446] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.487612] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.487727] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.487960] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.488125] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.488487] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a is going to be created. [ 738.535738] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.535738] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.535738] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.535961] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.538438] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.538713] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.586936] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 738.587209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.587483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.587713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.588066] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.588225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.588322] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.588570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.588713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.588869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.589089] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.590935] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.590935] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.591817] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.591924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.591971] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.592161] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.592279] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.592656] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.893407] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.984296] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: SUCCESS [ 738.984567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.985565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.985565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.985565] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.985565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.985565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.985565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.985565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.986164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.986164] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.095304] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.095304] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.095304] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.265143] env[69343]: INFO networking_nsxv3.common.synchronization [req-98625841-b85d-445c-a939-77beec9e7a27 req-3d3b123a-9aa6-4f9f-abad-cbd5a90bc10b service nova] Enqueued Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGHEST for action security_group_rules [ 739.265143] env[69343]: INFO networking_nsxv3.common.synchronization [req-98625841-b85d-445c-a939-77beec9e7a27 req-3d3b123a-9aa6-4f9f-abad-cbd5a90bc10b service nova] Enqueued Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGHEST for action security_group_members [ 739.265143] env[69343]: INFO networking_nsxv3.common.synchronization [req-98625841-b85d-445c-a939-77beec9e7a27 req-3d3b123a-9aa6-4f9f-abad-cbd5a90bc10b service nova] Enqueued Resource ID: 2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a with Priority: HIGHEST for action port [ 739.265143] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGHEST for action security_group_rules [ 739.265143] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGHEST for action security_group_members [ 739.265143] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a with Priority: HIGHEST for action port [ 739.266052] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-992f0e18-2006-4c90-ae32-07de7a98af22 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.266277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.266318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.266623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.266711] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.268858] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-992f0e18-2006-4c90-ae32-07de7a98af22 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.268858] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.268858] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.268858] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.268994] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.269183] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.269315] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.269555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.269727] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.269997] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.271622] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.272774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.272774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.273061] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.273727] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.396413] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.396542] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.396671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.396986] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.396986] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.397102] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be created. [ 739.431035] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.431035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.431035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.431035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.431340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.442994] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: UNINITIALIZED for 2s [ 739.487910] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.597073] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.708826] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 in Status: SUCCESS [ 739.710119] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.710119] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.710119] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.710119] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.777147] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-992f0e18-2006-4c90-ae32-07de7a98af22 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.778110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.778406] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.779370] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a with status ACTIVE [ 739.779994] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.779994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.779994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.780212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.780355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.780598] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.780748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.781324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.781324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.781324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.781324] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.781576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.781576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.783408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.783408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.783408] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a is going to be updated. [ 739.811603] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.811774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.811849] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.812081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.812240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.812453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c65ee04-8f5f-47e0-bb84-c45e5b2a3d2a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.990308] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc: rpc.has_security_group_logging(os_id): False [ 740.015290] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.015290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.015290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.015290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.015290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.015290] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.015290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.015290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.015290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.015290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.015290] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc is going to be created. [ 740.086953] env[69343]: INFO networking_nsxv3.common.synchronization [req-f15a38c6-c3e9-43dc-b397-655749090d2f req-f1b1d94e-b1b3-4089-877c-75d093ecdf44 tempest-ListImageFiltersTestJSON-216247362 tempest-ListImageFiltersTestJSON-216247362-project-member] Enqueued Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGHEST for action security_group_members [ 740.086953] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGHEST for action security_group_members [ 740.087441] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-992f0e18-2006-4c90-ae32-07de7a98af22 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.087681] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.091236] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.091532] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.092251] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.093274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.093581] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.100264] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.100653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.103454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.103454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.103454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.103454] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 740.110150] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: IN_PROGRESS for 2s [ 740.120540] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 in Status: SUCCESS [ 740.120540] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.120540] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.121853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.121853] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.121853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.121853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.121853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.121853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.121853] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.142203] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.142203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.142203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.142203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.142203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.162718] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 740.211758] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.211893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.284487] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.386217] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.386721] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.386721] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.386980] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.389172] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.389655] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.389810] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.390210] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.390397] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.390640] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.390808] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.390951] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.391089] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.391249] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.391299] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.391450] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.412378] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.412605] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 740.412810] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.413070] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.413496] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-a47e128e-5d4b-493a-a2ab-480a98f83418 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.413714] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-a47e128e-5d4b-493a-a2ab-480a98f83418" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.413867] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-a47e128e-5d4b-493a-a2ab-480a98f83418" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.414291] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-a47e128e-5d4b-493a-a2ab-480a98f83418" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.414463] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a47e128e-5d4b-493a-a2ab-480a98f83418',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.434709] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f in Status: SUCCESS [ 740.435271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.623685] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.787638] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.787854] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.788025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.788172] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.788267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.788382] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 992f0e18-2006-4c90-ae32-07de7a98af22 is going to be created. [ 740.813151] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.814351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.814470] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.814708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.816640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.825123] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 992f0e18-2006-4c90-ae32-07de7a98af22 in Status: UNINITIALIZED for 2s [ 740.918222] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.918468] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.918596] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.918871] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.919029] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.919260] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port a47e128e-5d4b-493a-a2ab-480a98f83418 not found, creating... [ 740.919470] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.919681] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.919741] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.920010] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.920165] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.920461] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.920703] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.920846] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.921173] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.921361] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.921618] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: a47e128e-5d4b-493a-a2ab-480a98f83418 is going to be created. [ 740.943959] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.944155] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.944208] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.944478] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.944761] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.944924] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-a47e128e-5d4b-493a-a2ab-480a98f83418" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.128939] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.454762] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 741.455062] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.455298] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.455571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.455719] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.455852] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.455948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.456210] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.456210] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.456671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.456671] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.632093] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.632373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.632498] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.632807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.632807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.632940] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 is going to be updated. [ 741.699390] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.699390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.699390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.699390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.699390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.716993] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 in Status: IN_PROGRESS for 2s [ 741.732887] env[69343]: INFO networking_nsxv3.common.synchronization [req-f15a38c6-c3e9-43dc-b397-655749090d2f req-0f9b92dd-da63-4958-a211-ff50e1b8b8fb service nova] Enqueued Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGHEST for action security_group_rules [ 741.733064] env[69343]: INFO networking_nsxv3.common.synchronization [req-f15a38c6-c3e9-43dc-b397-655749090d2f req-0f9b92dd-da63-4958-a211-ff50e1b8b8fb service nova] Enqueued Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGHEST for action security_group_members [ 741.733204] env[69343]: INFO networking_nsxv3.common.synchronization [req-f15a38c6-c3e9-43dc-b397-655749090d2f req-0f9b92dd-da63-4958-a211-ff50e1b8b8fb service nova] Enqueued Resource ID: a47e128e-5d4b-493a-a2ab-480a98f83418 with Priority: HIGHEST for action port [ 741.733424] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGHEST for action security_group_rules [ 741.733676] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGHEST for action security_group_members [ 741.733676] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e128e-5d4b-493a-a2ab-480a98f83418 with Priority: HIGHEST for action port [ 741.734265] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-992f0e18-2006-4c90-ae32-07de7a98af22 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.734357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.734782] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-992f0e18-2006-4c90-ae32-07de7a98af22 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.734782] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.734932] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-a47e128e-5d4b-493a-a2ab-480a98f83418 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.735036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a47e128e-5d4b-493a-a2ab-480a98f83418" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.735036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a47e128e-5d4b-493a-a2ab-480a98f83418" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.735243] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a47e128e-5d4b-493a-a2ab-480a98f83418" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.735340] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a47e128e-5d4b-493a-a2ab-480a98f83418',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.960087] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.960267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.960366] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.960657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.960864] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.960969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.961086] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.961299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.961437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.961592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.961780] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.961894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.961992] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.962144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.962297] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.962390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.962451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.962589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.962664] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.962746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.962834] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.125032] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: SUCCESS [ 742.125288] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.181479] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 742.181479] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.181479] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.181856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.181888] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.182071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.182187] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.182420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.182540] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.182675] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.239023] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a47e128e-5d4b-493a-a2ab-480a98f83418 with status ACTIVE [ 742.239023] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.239023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.239023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.239023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.239362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.239362] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.239461] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.239527] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.239812] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.240039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.240269] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.240401] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.240465] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.240638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.240723] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.240813] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a47e128e-5d4b-493a-a2ab-480a98f83418 is going to be updated. [ 742.268063] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.268264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.268264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.268365] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.268514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.268683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a47e128e-5d4b-493a-a2ab-480a98f83418" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.465580] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3973f86f-0821-4b7d-9e21-ccfe561c705b: rpc.has_security_group_logging(os_id): False [ 742.487449] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.487449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.487449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.487449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.487449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.487449] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.487449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.487449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.487449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.487449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.487449] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.491121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.491121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.491121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.491121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.491121] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.491121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.491121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.491121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.491121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.491121] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be created. [ 742.563839] env[69343]: INFO networking_nsxv3.common.synchronization [req-f701160f-3453-4c45-a85b-6c2bba818cd2 req-378bf72a-4f80-4e9c-bc5f-c12a320b68ad tempest-ImagesOneServerTestJSON-56318304 tempest-ImagesOneServerTestJSON-56318304-project-member] Enqueued Resource ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee with Priority: HIGHEST for action security_group_members [ 742.564648] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee with Priority: HIGHEST for action security_group_members [ 742.564935] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.565078] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.565190] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.565383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.565550] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.565651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.565720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.565873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.565986] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.566065] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8724753-bf27-4f9c-95b9-1ddfd48e01ee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.568560] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.568690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.568738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.568912] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.569121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.586203] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 742.685463] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.839023] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 992f0e18-2006-4c90-ae32-07de7a98af22 in Status: SUCCESS [ 742.839023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.839023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.839023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.839023] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.839023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.839023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.839023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.839023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.839023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.839023] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.839685] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.840027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.840296] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.840509] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.840651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.840868] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.841102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.841299] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.068777] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.068986] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.069078] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.069314] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.069425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.069647] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.069745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.069816] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.072301] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.072442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.072561] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee is going to be updated. [ 743.131331] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.131533] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.131533] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.131796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.131948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.141679] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee in Status: IN_PROGRESS for 2s [ 743.187912] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.344988] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-992f0e18-2006-4c90-ae32-07de7a98af22 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.345187] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.345409] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.690682] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.691096] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.691259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.691437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.691571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.691714] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 743.724439] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.724439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.724439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.724439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.724439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.731324] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 in Status: SUCCESS [ 743.732660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.732660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.732660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.732660] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.732660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.732998] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.732998] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.732998] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.733194] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.733194] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.734845] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 743.848577] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.236442] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.351644] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.351820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.351889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.352109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.352201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.352325] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 992f0e18-2006-4c90-ae32-07de7a98af22 is going to be updated. [ 744.387937] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.387937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.387937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.387937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.388406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.401279] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 992f0e18-2006-4c90-ae32-07de7a98af22 in Status: IN_PROGRESS for 2s [ 744.605712] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 744.605712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.739104] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3: rpc.has_security_group_logging(os_id): False [ 744.759117] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.759588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.759588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.759588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.759706] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.759850] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.759988] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.760103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.760281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.760350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.760438] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 is going to be updated. [ 744.825806] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.826185] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.826356] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.826762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.828324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.841995] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 in Status: IN_PROGRESS for 2s [ 745.152459] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee in Status: SUCCESS [ 745.152712] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee deletion is rescheduled due to dependency. [ 745.152787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.747036] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 745.747036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.747347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.747347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.747478] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.747600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.747664] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.747811] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.747969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.748090] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.748249] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.748343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.748451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.748544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.748817] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.748915] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.748979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.749132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.749210] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.749291] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.749380] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.252885] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40a389c1-84ea-4a8d-9f0b-0df3c555e73b: rpc.has_security_group_logging(os_id): False [ 746.273833] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.273988] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.275303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.275303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.275303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.275303] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.275303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.275303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.276833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.276833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.276833] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.276948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.276948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.277100] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.277186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.277414] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.277517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.277653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.277783] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.277906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.277949] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 746.366684] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.366926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.367009] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.367240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.367399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.392236] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 746.417286] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 992f0e18-2006-4c90-ae32-07de7a98af22 in Status: SUCCESS [ 746.418342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.418342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.418342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.418342] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.418640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.418640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.418731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.418891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.419040] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.858711] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 in Status: SUCCESS [ 746.859018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.921750] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.348312] env[69343]: INFO networking_nsxv3.common.synchronization [req-1f6297cb-09de-4877-ac7e-985d6468dd64 req-8e70f815-f72d-44f9-b8a5-1abbbfb180c0 tempest-AttachVolumeTestJSON-1370042024 tempest-AttachVolumeTestJSON-1370042024-project-member] Enqueued Resource ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b with Priority: HIGHEST for action security_group_members [ 747.349295] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b with Priority: HIGHEST for action security_group_members [ 747.349295] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.349295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.349295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.349703] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.349773] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.350012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.350012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.350193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.350283] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.350376] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.426702] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.757054] env[69343]: INFO networking_nsxv3.common.synchronization [req-3d1233cf-4aa7-4976-bc86-44e7ad86e96e req-e703c451-ee34-4242-a2c9-e8d1ae561b3d tempest-ImagesTestJSON-628353040 tempest-ImagesTestJSON-628353040-project-member] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 747.757762] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 747.758282] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.758427] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.758517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.758763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.758988] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.759146] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.759214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.759422] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.759523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.759630] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.853511] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.853590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.853698] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.853924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.854031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.854429] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.854624] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.854729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.855041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.855218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.855404] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b already deleted. [ 747.855603] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.932816] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.934028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.934028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.934940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.935751] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.936041] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 992f0e18-2006-4c90-ae32-07de7a98af22 is going to be updated. [ 747.968534] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-93 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.969052] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-93" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.969052] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-93" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.971569] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-93" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.971569] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.971569] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.971569] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.971569] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.971569] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.971569] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 747.971569] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.971569] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.972171] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.972500] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 747.972685] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.972860] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.975609] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.975609] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.975609] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.975609] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.976080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.993870] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 992f0e18-2006-4c90-ae32-07de7a98af22 in Status: IN_PROGRESS for 2s [ 748.003149] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.003328] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 748.003453] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.003659] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-93" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.004024] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-9afe6357-ec12-4f53-b9bc-80beeb1f6f77 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.004201] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-9afe6357-ec12-4f53-b9bc-80beeb1f6f77" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.004326] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-9afe6357-ec12-4f53-b9bc-80beeb1f6f77" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.004699] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-9afe6357-ec12-4f53-b9bc-80beeb1f6f77" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.004803] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9afe6357-ec12-4f53-b9bc-80beeb1f6f77',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.262211] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.262375] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.262436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.262649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.262744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.262939] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.263047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.263113] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.263276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.263353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.263441] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 748.291182] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.291182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.291182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.291182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.291182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.301874] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 748.408046] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 748.408046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.408046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.408253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.408336] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.507520] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.507811] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.508096] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.508389] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.508539] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.508688] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 9afe6357-ec12-4f53-b9bc-80beeb1f6f77 not found, creating... [ 748.508960] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.509126] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.509241] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.509490] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.511266] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.511266] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.511266] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.511266] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.511266] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.511266] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.511266] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 9afe6357-ec12-4f53-b9bc-80beeb1f6f77 is going to be created. [ 748.531956] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.532365] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.532524] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.532787] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.535015] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.535015] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-9afe6357-ec12-4f53-b9bc-80beeb1f6f77" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.911437] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.911608] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.911668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.911873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.912055] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.912162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.912223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.912402] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.912531] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.912590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.912663] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.416208] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.416492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.416492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.416706] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.417068] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.417068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.417274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.417274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.418334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.418334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.418334] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.418334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.418334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.418334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.418334] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.418334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.418334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.418674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.418674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.418674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.418674] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.682988] env[69343]: INFO networking_nsxv3.common.synchronization [req-1f6297cb-09de-4877-ac7e-985d6468dd64 req-c8635821-7702-449d-a6eb-432672e3347d service nova] Enqueued Resource ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b with Priority: HIGHEST for action security_group_rules [ 749.683078] env[69343]: INFO networking_nsxv3.common.synchronization [req-1f6297cb-09de-4877-ac7e-985d6468dd64 req-c8635821-7702-449d-a6eb-432672e3347d service nova] Enqueued Resource ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b with Priority: HIGHEST for action security_group_members [ 749.683218] env[69343]: INFO networking_nsxv3.common.synchronization [req-1f6297cb-09de-4877-ac7e-985d6468dd64 req-c8635821-7702-449d-a6eb-432672e3347d service nova] Enqueued Resource ID: 9afe6357-ec12-4f53-b9bc-80beeb1f6f77 with Priority: HIGHEST for action port [ 749.683744] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b with Priority: HIGHEST for action security_group_rules [ 749.683876] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b with Priority: HIGHEST for action security_group_members [ 749.684033] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afe6357-ec12-4f53-b9bc-80beeb1f6f77 with Priority: HIGHEST for action port [ 749.684302] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.684364] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.684414] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.684610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.684689] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.685523] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.685684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.685727] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.685862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.686011] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.686102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.686161] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.686301] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.686382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.686486] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.691028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-9afe6357-ec12-4f53-b9bc-80beeb1f6f77 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.691028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9afe6357-ec12-4f53-b9bc-80beeb1f6f77" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.691028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9afe6357-ec12-4f53-b9bc-80beeb1f6f77" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.691028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9afe6357-ec12-4f53-b9bc-80beeb1f6f77" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.691028] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9afe6357-ec12-4f53-b9bc-80beeb1f6f77',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.923401] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40a389c1-84ea-4a8d-9f0b-0df3c555e73b: rpc.has_security_group_logging(os_id): False [ 749.941628] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.941768] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.941854] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.942068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.942166] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.942398] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.942511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.942578] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.942739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.942819] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.942996] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.943108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.943173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.943315] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.943394] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.943579] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.943673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.943735] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.943874] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.943950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.944066] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 750.005396] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 992f0e18-2006-4c90-ae32-07de7a98af22 in Status: SUCCESS [ 750.005646] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.005828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.006055] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.006248] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.006362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.006427] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.006626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.006738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.006831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.006987] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-992f0e18-2006-4c90-ae32-07de7a98af22 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.007108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.007203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.007338] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.007526] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.007592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.007626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.007773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.008114] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.008114] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.008262] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.020554] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.020730] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.020784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.021025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.021209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.041162] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 750.190343] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.190481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.190679] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.191606] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9afe6357-ec12-4f53-b9bc-80beeb1f6f77 with status ACTIVE [ 750.191788] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.192040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.192040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.192269] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.192269] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.192797] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.192797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.192797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.192797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.192797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.193109] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.193109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.193109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.193251] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.193314] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.194361] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9afe6357-ec12-4f53-b9bc-80beeb1f6f77 is going to be updated. [ 750.217872] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.218070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.218176] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.218410] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.218550] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.218706] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9afe6357-ec12-4f53-b9bc-80beeb1f6f77" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.323186] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 750.323613] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b deletion is rescheduled due to dependency. [ 750.323732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.510361] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 992f0e18-2006-4c90-ae32-07de7a98af22: rpc.has_security_group_logging(os_id): False [ 750.533018] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.533018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.533018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.533018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.533257] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.533880] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.533880] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.533880] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.533880] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.533880] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.533880] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.534132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.534132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.534185] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.534466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.534466] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.534751] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.534751] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.534852] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.534899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.535012] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 992f0e18-2006-4c90-ae32-07de7a98af22 is going to be created. [ 750.602667] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.602885] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.602885] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.603120] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.603326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.616872] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 992f0e18-2006-4c90-ae32-07de7a98af22 in Status: IN_PROGRESS for 2s [ 750.695515] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.198373] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.198496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.198626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.199112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.199112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.199112] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b is going to be created. [ 751.223862] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.224035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.224136] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.224374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.224559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.236211] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b in Status: UNINITIALIZED for 2s [ 752.057357] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 752.057635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.631469] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 992f0e18-2006-4c90-ae32-07de7a98af22 in Status: SUCCESS [ 752.631834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.632168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.632509] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.632663] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.137503] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-992f0e18-2006-4c90-ae32-07de7a98af22 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.140752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.140752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.140752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.140752] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.140752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.140752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.140752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.140752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.140752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.140752] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.245091] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b in Status: SUCCESS [ 753.245339] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.245509] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.246528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.246605] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.246734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.246802] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.246979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.247090] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.247185] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.247279] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.642484] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-992f0e18-2006-4c90-ae32-07de7a98af22 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.642617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.642658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.643310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.643310] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.643310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.643310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.643696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.643696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.643696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.643696] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-992f0e18-2006-4c90-ae32-07de7a98af22 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.643889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.643889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.644020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.644190] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.644289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.644385] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.644498] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.644886] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.644886] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.644886] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.750389] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.149264] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 992f0e18-2006-4c90-ae32-07de7a98af22: rpc.has_security_group_logging(os_id): False [ 754.168643] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.168785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.168903] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.169083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.169181] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.169444] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.169550] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.169618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.170305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.170305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.170305] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.170458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.170458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.170635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.170706] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.170890] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.170985] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.171085] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.171289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.171404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.171498] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 992f0e18-2006-4c90-ae32-07de7a98af22 is going to be updated. [ 754.245032] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.245032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.245032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.245032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.245032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.253483] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b: rpc.has_security_group_logging(os_id): False [ 754.274733] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.275076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.275076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.275301] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.275301] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.275526] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.275627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.275690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.275849] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.275926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.276015] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b is going to be created. [ 754.277756] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 992f0e18-2006-4c90-ae32-07de7a98af22 in Status: IN_PROGRESS for 2s [ 754.417162] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.417162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.417708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.417890] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.418281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.436263] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b in Status: IN_PROGRESS for 2s [ 754.685841] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 754.685841] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 756.297193] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 992f0e18-2006-4c90-ae32-07de7a98af22 in Status: SUCCESS [ 756.297610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.416366] env[69343]: INFO networking_nsxv3.common.synchronization [req-d9cc0719-5998-49c0-91fc-ac8b0aa4188b req-bfc19822-cf2a-4d1f-8905-231bb0b273f9 tempest-ServersAdminTestJSON-624451732 tempest-ServersAdminTestJSON-624451732-project-member] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 756.416962] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 756.416962] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.417159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.417159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.417304] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.417464] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.417565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.417629] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.417969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.417969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.417969] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.455657] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b in Status: SUCCESS [ 756.455885] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.920290] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.424104] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.488125] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-621 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.488387] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-621" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.488549] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-621" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.489064] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-621" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.489369] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.489572] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.489748] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.490065] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.490340] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.490621] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.490766] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.490892] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.491052] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.491373] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.491562] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.491751] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.516760] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.516760] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 757.516760] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.516760] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-621" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.517061] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-3938360c-6807-4876-bc5f-d232866d3bdd taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.517061] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-3938360c-6807-4876-bc5f-d232866d3bdd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.517212] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-3938360c-6807-4876-bc5f-d232866d3bdd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.517558] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-3938360c-6807-4876-bc5f-d232866d3bdd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.517669] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3938360c-6807-4876-bc5f-d232866d3bdd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.931073] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.931073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.931073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.931073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.931073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.931073] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be updated. [ 757.967032] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.967032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.967032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.967348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.971022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.979369] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: IN_PROGRESS for 2s [ 758.025441] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.025743] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.025887] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.026320] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.026535] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.026718] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 3938360c-6807-4876-bc5f-d232866d3bdd not found, creating... [ 758.027175] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.027351] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.027522] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.027774] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.027935] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.029219] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.029442] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.029548] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.030059] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.030318] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.030487] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 3938360c-6807-4876-bc5f-d232866d3bdd is going to be created. [ 758.062335] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.062699] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.062931] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.063382] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.063746] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.064681] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-3938360c-6807-4876-bc5f-d232866d3bdd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.744775] env[69343]: INFO networking_nsxv3.common.synchronization [None req-ee917fa1-25ac-472e-a5cf-a18f283a46b3 None None] Enqueued Resource ID: dc75a5d6-ed07-4b1a-9dcb-b2f64f722226 with Priority: HIGHEST for action port [ 758.744775] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc75a5d6-ed07-4b1a-9dcb-b2f64f722226 with Priority: HIGHEST for action port [ 758.748811] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc75a5d6-ed07-4b1a-9dcb-b2f64f722226 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.749107] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc75a5d6-ed07-4b1a-9dcb-b2f64f722226" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.749291] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc75a5d6-ed07-4b1a-9dcb-b2f64f722226" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.749587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc75a5d6-ed07-4b1a-9dcb-b2f64f722226" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.749765] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc75a5d6-ed07-4b1a-9dcb-b2f64f722226',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.252150] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc75a5d6-ed07-4b1a-9dcb-b2f64f722226 [ 759.252611] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.252755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.252816] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.253081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.253219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.253341] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc75a5d6-ed07-4b1a-9dcb-b2f64f722226 already deleted. [ 759.253453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc75a5d6-ed07-4b1a-9dcb-b2f64f722226" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.496719] env[69343]: INFO networking_nsxv3.common.synchronization [req-d9cc0719-5998-49c0-91fc-ac8b0aa4188b req-41455ec8-0ce0-4745-b7ad-d4d36ade0bb2 service nova] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_rules [ 759.496953] env[69343]: INFO networking_nsxv3.common.synchronization [req-d9cc0719-5998-49c0-91fc-ac8b0aa4188b req-41455ec8-0ce0-4745-b7ad-d4d36ade0bb2 service nova] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 759.497871] env[69343]: INFO networking_nsxv3.common.synchronization [req-d9cc0719-5998-49c0-91fc-ac8b0aa4188b req-41455ec8-0ce0-4745-b7ad-d4d36ade0bb2 service nova] Enqueued Resource ID: 3938360c-6807-4876-bc5f-d232866d3bdd with Priority: HIGHEST for action port [ 759.498732] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_rules [ 759.498975] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 759.499839] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3938360c-6807-4876-bc5f-d232866d3bdd with Priority: HIGHEST for action port [ 759.500748] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.500888] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.500956] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.501211] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.501301] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.502227] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.502367] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.502565] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-3938360c-6807-4876-bc5f-d232866d3bdd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.502673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3938360c-6807-4876-bc5f-d232866d3bdd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.502740] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3938360c-6807-4876-bc5f-d232866d3bdd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.503798] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3938360c-6807-4876-bc5f-d232866d3bdd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.503798] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3938360c-6807-4876-bc5f-d232866d3bdd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.857223] env[69343]: INFO networking_nsxv3.common.synchronization [None req-4c97fc70-ff92-47af-acf5-571a1368e449 tempest-ServerActionsV293TestJSON-480392759 tempest-ServerActionsV293TestJSON-480392759-project-member] Enqueued Resource ID: b7614721-7a3e-40ba-83da-998503180bf3 with Priority: HIGHEST for action security_group_rules [ 759.857905] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7614721-7a3e-40ba-83da-998503180bf3 with Priority: HIGHEST for action security_group_rules [ 759.858146] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7614721-7a3e-40ba-83da-998503180bf3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.858269] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.858334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.858591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.858664] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7614721-7a3e-40ba-83da-998503180bf3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.959104] env[69343]: INFO networking_nsxv3.common.synchronization [None req-c6cb2c85-6447-4c84-808d-eea15c29a932 tempest-ServerActionsV293TestJSON-480392759 tempest-ServerActionsV293TestJSON-480392759-project-member] Enqueued Resource ID: b7614721-7a3e-40ba-83da-998503180bf3 with Priority: HIGHEST for action security_group_rules [ 759.961022] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7614721-7a3e-40ba-83da-998503180bf3 with Priority: HIGHEST for action security_group_rules [ 759.961022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7614721-7a3e-40ba-83da-998503180bf3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.961022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.993177] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: SUCCESS [ 759.993543] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.994169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.994402] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.994602] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.994718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.994780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.994944] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.995044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.995145] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.006614] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.006614] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.010873] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3938360c-6807-4876-bc5f-d232866d3bdd with status ACTIVE [ 760.011055] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.011181] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.011365] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.011776] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.011776] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.011967] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.012197] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.012353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.012949] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.012949] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.013095] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.013225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.013360] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.013585] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.013693] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.013790] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3938360c-6807-4876-bc5f-d232866d3bdd is going to be updated. [ 760.035990] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.036180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.036245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.036470] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.036622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.036790] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3938360c-6807-4876-bc5f-d232866d3bdd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.261530] env[69343]: INFO networking_nsxv3.common.synchronization [req-c3982884-c044-43ef-98d5-2f0683e4c420 req-971aeb71-b079-4531-9b3d-d67d3da02415 tempest-ServerDiskConfigTestJSON-1018188129 tempest-ServerDiskConfigTestJSON-1018188129-project-member] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 760.262378] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 760.262531] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.263374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.263374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.263374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.263555] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.263555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.263656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.264043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.264164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.264277] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.386715] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.386909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.387281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.387281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.387432] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.387432] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7614721-7a3e-40ba-83da-998503180bf3 already deleted. [ 760.387517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.387675] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.387864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.387955] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7614721-7a3e-40ba-83da-998503180bf3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.507539] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.769286] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.769286] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.769286] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.769286] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.769286] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.769513] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.769564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.769687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.769822] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.769898] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.769984] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 760.805635] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.805801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.805844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.806636] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.806636] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.817311] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 760.912894] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.913223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.913223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.913429] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.913429] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.913566] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7614721-7a3e-40ba-83da-998503180bf3 already deleted. [ 760.913602] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.009334] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.516396] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.516640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.516698] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.516899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.516994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.517121] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be updated. [ 761.552332] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.552585] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.552656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.552878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.553048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.566480] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: IN_PROGRESS for 2s [ 761.767788] env[69343]: INFO networking_nsxv3.common.synchronization [None req-2e64fa73-ddf7-4b9b-8e05-b47e4306e215 None None] Enqueued Resource ID: 439b46fe-5cbd-462a-bbf0-2eda48ea9b98 with Priority: HIGHEST for action port [ 761.768732] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 439b46fe-5cbd-462a-bbf0-2eda48ea9b98 with Priority: HIGHEST for action port [ 761.769027] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-439b46fe-5cbd-462a-bbf0-2eda48ea9b98 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.769298] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-439b46fe-5cbd-462a-bbf0-2eda48ea9b98" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.769384] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-439b46fe-5cbd-462a-bbf0-2eda48ea9b98" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.769705] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-439b46fe-5cbd-462a-bbf0-2eda48ea9b98" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.769824] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('439b46fe-5cbd-462a-bbf0-2eda48ea9b98',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.275249] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 439b46fe-5cbd-462a-bbf0-2eda48ea9b98 [ 762.275249] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.275249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.275249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.275249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.275249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.275249] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:439b46fe-5cbd-462a-bbf0-2eda48ea9b98 already deleted. [ 762.275249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-439b46fe-5cbd-462a-bbf0-2eda48ea9b98" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.828172] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 762.828723] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b deletion is rescheduled due to dependency. [ 762.828723] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.577473] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: SUCCESS [ 763.577865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.577915] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.578201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.578438] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.578570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.578636] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.578808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.578895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.578985] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.579097] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.083148] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.083148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.083148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.083148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.083148] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.083148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.083148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.083630] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.083630] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.083630] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.083722] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.083760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.083819] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.083986] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.084141] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.084240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.084288] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.084701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.084701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.084701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.084701] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.586872] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a: rpc.has_security_group_logging(os_id): False [ 764.608209] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.608425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.608551] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.609317] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.609317] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.609317] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.609601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.609601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.609793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.609927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.610483] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.610645] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.610725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.610899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.611017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.611456] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.611578] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.611649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.611825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.611964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.612081] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be updated. [ 764.678623] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.678861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.678861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.679084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.679235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.698556] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: IN_PROGRESS for 2s [ 766.723236] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: SUCCESS [ 766.723585] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.770545] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 766.770545] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 767.990104] env[69343]: INFO networking_nsxv3.common.synchronization [req-2f86ac50-7fcc-4bc0-87c8-11be9aec5763 req-a4b6f374-e397-4b33-a269-e7413a27546d tempest-ServerActionsTestJSON-1397784852 tempest-ServerActionsTestJSON-1397784852-project-member] Enqueued Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 767.990768] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 767.991432] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.991658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.991731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.995084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.995084] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.995084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.995084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.995084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.995084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.995084] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.417803] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.418050] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-988" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.418256] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-988" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.418656] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-988" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.418970] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.419238] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.419454] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.419715] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.419972] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.420126] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.420357] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.420422] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.420541] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.420953] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.421098] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.421418] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.442393] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.442673] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 768.442865] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.443191] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-988" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.443558] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-5d4ef60e-dffd-47ae-9c8c-5589e2b54e43 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.443780] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-5d4ef60e-dffd-47ae-9c8c-5589e2b54e43" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.443931] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-5d4ef60e-dffd-47ae-9c8c-5589e2b54e43" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.444307] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-5d4ef60e-dffd-47ae-9c8c-5589e2b54e43" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.444513] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d4ef60e-dffd-47ae-9c8c-5589e2b54e43',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.503253] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.503253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.503253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.503253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.503253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.503446] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.503446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.503522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.503629] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.503704] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.503786] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 already deleted. [ 768.503867] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.951733] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.951974] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.952128] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.952414] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.952569] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.952726] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 5d4ef60e-dffd-47ae-9c8c-5589e2b54e43 not found, creating... [ 768.952991] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.953165] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.953357] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.953585] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.953725] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.954026] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.954248] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.954370] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.954626] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.954706] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.954848] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 5d4ef60e-dffd-47ae-9c8c-5589e2b54e43 is going to be created. [ 768.974996] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.975223] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.975401] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.975617] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.975845] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.976075] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-5d4ef60e-dffd-47ae-9c8c-5589e2b54e43" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.905837] env[69343]: INFO networking_nsxv3.common.synchronization [req-2f86ac50-7fcc-4bc0-87c8-11be9aec5763 req-38c317f6-59c0-4779-b77c-0478f111cb3d service nova] Enqueued Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_rules [ 769.906095] env[69343]: INFO networking_nsxv3.common.synchronization [req-2f86ac50-7fcc-4bc0-87c8-11be9aec5763 req-38c317f6-59c0-4779-b77c-0478f111cb3d service nova] Enqueued Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 769.906244] env[69343]: INFO networking_nsxv3.common.synchronization [req-2f86ac50-7fcc-4bc0-87c8-11be9aec5763 req-38c317f6-59c0-4779-b77c-0478f111cb3d service nova] Enqueued Resource ID: 5d4ef60e-dffd-47ae-9c8c-5589e2b54e43 with Priority: HIGHEST for action port [ 769.906823] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_rules [ 769.906967] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 769.907146] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d4ef60e-dffd-47ae-9c8c-5589e2b54e43 with Priority: HIGHEST for action port [ 769.907437] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.907564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.907634] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.907882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.907968] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.909525] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.909699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.909787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.909981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.910199] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.910358] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.910358] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.910564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.910596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.910716] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.911661] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d4ef60e-dffd-47ae-9c8c-5589e2b54e43 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.911764] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d4ef60e-dffd-47ae-9c8c-5589e2b54e43" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.912027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d4ef60e-dffd-47ae-9c8c-5589e2b54e43" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.912027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d4ef60e-dffd-47ae-9c8c-5589e2b54e43" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.912097] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d4ef60e-dffd-47ae-9c8c-5589e2b54e43',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.414295] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.414454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.415328] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.416325] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d4ef60e-dffd-47ae-9c8c-5589e2b54e43 with status ACTIVE [ 770.416445] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.416542] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.416620] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.416806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.417097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.417097] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.417252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.417252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.417402] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.417482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.417710] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.417794] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.418930] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.418930] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.418930] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.418930] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d4ef60e-dffd-47ae-9c8c-5589e2b54e43 is going to be updated. [ 770.442471] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.442471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.442471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.442471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.442471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.442963] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d4ef60e-dffd-47ae-9c8c-5589e2b54e43" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.574291] env[69343]: INFO networking_nsxv3.common.synchronization [req-552098be-cece-481d-952f-57b377d47943 req-bfbcf421-561e-409a-ab63-16b265ff0420 tempest-MigrationsAdminTest-544745941 tempest-MigrationsAdminTest-544745941-project-member] Enqueued Resource ID: 1db02b01-820f-4081-802a-12188735ffe1 with Priority: HIGHEST for action security_group_members [ 770.574851] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db02b01-820f-4081-802a-12188735ffe1 with Priority: HIGHEST for action security_group_members [ 770.575168] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db02b01-820f-4081-802a-12188735ffe1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.575291] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.575362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.575608] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.575991] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.576118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.576184] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.576610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.576774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.576932] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.920890] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.079097] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.344704] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.344899] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.345037] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.345314] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.345595] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.345766] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.345883] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.347616] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.348945] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.349308] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.350071] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.350337] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.350554] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.351865] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.352111] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.353043] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.374000] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.374290] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 771.374476] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.374672] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.375089] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-7c5811f0-4e24-4adc-97ae-1d3603e8c69c taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.375263] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-7c5811f0-4e24-4adc-97ae-1d3603e8c69c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.375559] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-7c5811f0-4e24-4adc-97ae-1d3603e8c69c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.375934] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-7c5811f0-4e24-4adc-97ae-1d3603e8c69c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.376125] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c5811f0-4e24-4adc-97ae-1d3603e8c69c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.423209] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.423425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.423524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.423809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.423942] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.424086] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 is going to be created. [ 771.455947] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.456193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.456287] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.456572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.456777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.471461] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: UNINITIALIZED for 2s [ 771.581449] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.878982] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.879690] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.880306] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.880674] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.880910] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.881150] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 7c5811f0-4e24-4adc-97ae-1d3603e8c69c not found, creating... [ 771.881498] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.881738] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.881876] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.883028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.883028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.883275] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.883514] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.883763] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.884317] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.884468] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.884732] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 7c5811f0-4e24-4adc-97ae-1d3603e8c69c is going to be created. [ 771.908966] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.909311] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.909448] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.909745] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.909997] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.910257] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-7c5811f0-4e24-4adc-97ae-1d3603e8c69c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.085508] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.085837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.085837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.085969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.086073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.086179] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db02b01-820f-4081-802a-12188735ffe1 is going to be updated. [ 772.119353] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.119683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.119868] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.120218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.120506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.133190] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db02b01-820f-4081-802a-12188735ffe1 in Status: IN_PROGRESS for 2s [ 772.830184] env[69343]: INFO networking_nsxv3.common.synchronization [req-552098be-cece-481d-952f-57b377d47943 req-0053c16a-cdc3-49fa-91a2-b5d20f6b9ba9 service nova] Enqueued Resource ID: 1db02b01-820f-4081-802a-12188735ffe1 with Priority: HIGHEST for action security_group_rules [ 772.830479] env[69343]: INFO networking_nsxv3.common.synchronization [req-552098be-cece-481d-952f-57b377d47943 req-0053c16a-cdc3-49fa-91a2-b5d20f6b9ba9 service nova] Enqueued Resource ID: 1db02b01-820f-4081-802a-12188735ffe1 with Priority: HIGHEST for action security_group_members [ 772.830711] env[69343]: INFO networking_nsxv3.common.synchronization [req-552098be-cece-481d-952f-57b377d47943 req-0053c16a-cdc3-49fa-91a2-b5d20f6b9ba9 service nova] Enqueued Resource ID: 7c5811f0-4e24-4adc-97ae-1d3603e8c69c with Priority: HIGHEST for action port [ 772.831311] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db02b01-820f-4081-802a-12188735ffe1 with Priority: HIGHEST for action security_group_rules [ 772.831518] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db02b01-820f-4081-802a-12188735ffe1 with Priority: HIGHEST for action security_group_members [ 772.831716] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c5811f0-4e24-4adc-97ae-1d3603e8c69c with Priority: HIGHEST for action port [ 772.832184] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1db02b01-820f-4081-802a-12188735ffe1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.832409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.832464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.833106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.833106] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.834055] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db02b01-820f-4081-802a-12188735ffe1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.834183] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.834451] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c5811f0-4e24-4adc-97ae-1d3603e8c69c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.834515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c5811f0-4e24-4adc-97ae-1d3603e8c69c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.834553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c5811f0-4e24-4adc-97ae-1d3603e8c69c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.834742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c5811f0-4e24-4adc-97ae-1d3603e8c69c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.834841] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c5811f0-4e24-4adc-97ae-1d3603e8c69c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.244029] env[69343]: INFO networking_nsxv3.common.synchronization [req-fa07878e-ecbb-4d63-8158-bdf98feae263 req-cac8b534-a16a-439a-a868-123c853768cd tempest-ServersTestMultiNic-93755808 tempest-ServersTestMultiNic-93755808-project-member] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 773.244611] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 773.244905] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.245038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.245120] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.245314] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.245472] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.245574] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.245658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.245815] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.245900] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.245994] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.342034] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db02b01-820f-4081-802a-12188735ffe1 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.342242] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.342338] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c5811f0-4e24-4adc-97ae-1d3603e8c69c with status ACTIVE [ 773.342575] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.342703] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.342783] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.343009] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.343111] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.343331] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.343468] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.343528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.343940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.343940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.343940] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.344237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.344237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.344237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.344424] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.344586] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c5811f0-4e24-4adc-97ae-1d3603e8c69c is going to be updated. [ 773.370172] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.370425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.370425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.370666] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.370756] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.371058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c5811f0-4e24-4adc-97ae-1d3603e8c69c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.557466] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: SUCCESS [ 773.557768] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.558073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.558481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.558760] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.558921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.559009] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.559218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.559331] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.559452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.559560] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.748789] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.748789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.751106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.752451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.753199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.753199] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.753199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.753199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.753199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.753439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.753439] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be updated. [ 773.782622] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.782796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.782899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.783443] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.783443] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.798040] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: IN_PROGRESS for 2s [ 773.804198] env[69343]: INFO networking_nsxv3.common.synchronization [req-fa07878e-ecbb-4d63-8158-bdf98feae263 req-12c4ef04-2778-415c-970a-89a40b7f8f06 tempest-ServersTestMultiNic-93755808 tempest-ServersTestMultiNic-93755808-project-member] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 773.805793] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 773.805793] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.805793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.062538] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.144915] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db02b01-820f-4081-802a-12188735ffe1 in Status: SUCCESS [ 774.145151] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.145347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.145567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.145752] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.145868] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.145926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.146096] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.146176] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.146271] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.320764] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-498 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.320764] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-498" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.320764] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-498" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.321344] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-498" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.322929] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.323207] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.323394] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.323653] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.323909] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.324054] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.324264] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 774.324415] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 774.324532] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 774.324650] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.324781] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 774.324950] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 774.344113] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 774.344274] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 774.344413] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 774.344592] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-498" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.344941] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-152968a1-d557-43b5-9d87-c5521d1bac9b taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.345174] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-152968a1-d557-43b5-9d87-c5521d1bac9b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.345300] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-152968a1-d557-43b5-9d87-c5521d1bac9b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.345617] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-152968a1-d557-43b5-9d87-c5521d1bac9b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.345757] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('152968a1-d557-43b5-9d87-c5521d1bac9b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.567440] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ceec863-0a7a-401b-a8e8-048823180971: rpc.has_security_group_logging(os_id): False [ 774.588581] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.588820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.588820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.589050] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.589144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.589459] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.589634] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.589634] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.589757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.589808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.589899] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 is going to be created. [ 774.648853] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.664653] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.664916] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.664978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.665190] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.665394] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.679205] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: IN_PROGRESS for 2s [ 774.848629] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.848932] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.849112] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.849528] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.849741] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.849970] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 152968a1-d557-43b5-9d87-c5521d1bac9b not found, creating... [ 774.850363] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.850590] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.850772] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.851097] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.851332] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.851837] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.851939] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.852104] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.852429] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.852623] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.852835] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 152968a1-d557-43b5-9d87-c5521d1bac9b is going to be created. [ 774.874036] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.874480] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.874738] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.875009] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.875333] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.875749] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-152968a1-d557-43b5-9d87-c5521d1bac9b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.151207] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.601101] env[69343]: INFO networking_nsxv3.common.synchronization [req-fa07878e-ecbb-4d63-8158-bdf98feae263 req-387a475d-3a47-4ee3-8201-99cb3b3cd0b0 service nova] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_rules [ 775.601101] env[69343]: INFO networking_nsxv3.common.synchronization [req-fa07878e-ecbb-4d63-8158-bdf98feae263 req-387a475d-3a47-4ee3-8201-99cb3b3cd0b0 service nova] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 775.601101] env[69343]: INFO networking_nsxv3.common.synchronization [req-fa07878e-ecbb-4d63-8158-bdf98feae263 req-387a475d-3a47-4ee3-8201-99cb3b3cd0b0 service nova] Enqueued Resource ID: 152968a1-d557-43b5-9d87-c5521d1bac9b with Priority: HIGHEST for action port [ 775.607969] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_rules [ 775.607969] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 775.607969] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152968a1-d557-43b5-9d87-c5521d1bac9b with Priority: HIGHEST for action port [ 775.607969] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.607969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.607969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.607969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.607969] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.607969] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.607969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.607969] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-152968a1-d557-43b5-9d87-c5521d1bac9b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.607969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-152968a1-d557-43b5-9d87-c5521d1bac9b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.607969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-152968a1-d557-43b5-9d87-c5521d1bac9b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.607969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-152968a1-d557-43b5-9d87-c5521d1bac9b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.607969] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('152968a1-d557-43b5-9d87-c5521d1bac9b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.654137] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.654322] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.654395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.654614] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.654709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.654807] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db02b01-820f-4081-802a-12188735ffe1 is going to be updated. [ 775.686088] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.686247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.686319] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.686530] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.686674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.695432] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db02b01-820f-4081-802a-12188735ffe1 in Status: IN_PROGRESS for 2s [ 775.806904] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: SUCCESS [ 775.807175] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee deletion is rescheduled due to dependency. [ 775.807298] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.807478] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.807722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.807914] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.808065] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.808132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.808427] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.808427] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.808505] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.114025] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 152968a1-d557-43b5-9d87-c5521d1bac9b with status ACTIVE [ 776.114025] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.114025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.114025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.114025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.114025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.114025] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.114025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.114025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.114025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.114025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.114025] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.114025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.114025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.114025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.114025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.114025] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 152968a1-d557-43b5-9d87-c5521d1bac9b is going to be updated. [ 776.116692] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.117276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.148160] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.148160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.148160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.148160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.148160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.148160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-152968a1-d557-43b5-9d87-c5521d1bac9b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.311285] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.616295] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-836 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.616295] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-836" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.616295] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-836" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.616295] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-836" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.616295] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.616800] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.616963] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.617335] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.617544] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.617858] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.618063] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.618322] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.618489] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.618653] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.619114] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.619114] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.662657] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.663044] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 776.663293] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.663520] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-836" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.663921] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-deff9c22-4d85-4c59-9c1e-439ddba82dfc taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.664136] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-deff9c22-4d85-4c59-9c1e-439ddba82dfc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.664274] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-deff9c22-4d85-4c59-9c1e-439ddba82dfc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.664733] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-deff9c22-4d85-4c59-9c1e-439ddba82dfc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.664903] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deff9c22-4d85-4c59-9c1e-439ddba82dfc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.694897] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: SUCCESS [ 776.695567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.819581] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.176490] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.177074] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.177074] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.177252] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.177300] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.177816] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port deff9c22-4d85-4c59-9c1e-439ddba82dfc not found, creating... [ 777.177816] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.178346] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.178346] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.178470] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.178983] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.178983] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.179268] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.179268] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.179894] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.179894] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.179894] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: deff9c22-4d85-4c59-9c1e-439ddba82dfc is going to be created. [ 777.204019] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.204477] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.204477] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.205067] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.205067] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.205067] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-deff9c22-4d85-4c59-9c1e-439ddba82dfc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.323701] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.323903] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.324084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.325389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.325389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.325389] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be updated. [ 777.396177] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.396415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.396484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.396795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.397058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.412757] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: IN_PROGRESS for 2s [ 777.706227] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db02b01-820f-4081-802a-12188735ffe1 in Status: SUCCESS [ 777.706525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.706729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.706957] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.707545] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.707545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.707545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.707689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.711022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.711022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.711022] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.215209] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db02b01-820f-4081-802a-12188735ffe1 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.215497] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.215597] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.216386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.216598] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.216711] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.216780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.217013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.217182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.221020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.221020] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db02b01-820f-4081-802a-12188735ffe1 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.221020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.221020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.221020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.221020] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.221020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.221020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.221020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.221020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.221020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.221020] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.422800] env[69343]: INFO networking_nsxv3.common.synchronization [req-fa07878e-ecbb-4d63-8158-bdf98feae263 req-03a7a922-a5c8-42ca-998a-c85d497476bc service nova] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_rules [ 778.422800] env[69343]: INFO networking_nsxv3.common.synchronization [req-fa07878e-ecbb-4d63-8158-bdf98feae263 req-03a7a922-a5c8-42ca-998a-c85d497476bc service nova] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 778.422893] env[69343]: INFO networking_nsxv3.common.synchronization [req-fa07878e-ecbb-4d63-8158-bdf98feae263 req-03a7a922-a5c8-42ca-998a-c85d497476bc service nova] Enqueued Resource ID: deff9c22-4d85-4c59-9c1e-439ddba82dfc with Priority: HIGHEST for action port [ 778.423531] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_rules [ 778.424511] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 778.424511] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deff9c22-4d85-4c59-9c1e-439ddba82dfc with Priority: HIGHEST for action port [ 778.424511] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.424511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.425037] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.425227] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.425897] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-deff9c22-4d85-4c59-9c1e-439ddba82dfc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.426108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-deff9c22-4d85-4c59-9c1e-439ddba82dfc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.426245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-deff9c22-4d85-4c59-9c1e-439ddba82dfc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.426623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-deff9c22-4d85-4c59-9c1e-439ddba82dfc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.427558] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deff9c22-4d85-4c59-9c1e-439ddba82dfc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.721969] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1db02b01-820f-4081-802a-12188735ffe1: rpc.has_security_group_logging(os_id): False [ 778.744615] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.744825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.744882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.745253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.745355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.745544] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.745668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.745779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.745882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.745981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.746224] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.746324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.746407] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.746706] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.746803] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.747031] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.747150] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.747220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.747384] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.747471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.747564] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1db02b01-820f-4081-802a-12188735ffe1 is going to be updated. [ 778.824114] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.824372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.824372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.824747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.824941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.840190] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db02b01-820f-4081-802a-12188735ffe1 in Status: IN_PROGRESS for 2s [ 778.931592] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port deff9c22-4d85-4c59-9c1e-439ddba82dfc with status ACTIVE [ 778.931592] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.931592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.931592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.931592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.931592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.931592] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.931592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.931592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.932055] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.932055] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.932126] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.933048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.933048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.933048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.933048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.933048] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: deff9c22-4d85-4c59-9c1e-439ddba82dfc is going to be updated. [ 778.972400] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.972538] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.972576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.972813] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.972964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.973919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-deff9c22-4d85-4c59-9c1e-439ddba82dfc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.139829] env[69343]: INFO networking_nsxv3.common.synchronization [req-8e347e57-8813-44bc-bc66-174ec6f61379 req-56bb208e-7b4e-4a41-a37a-b7dd456995d6 tempest-ServersTestFqdnHostnames-412725694 tempest-ServersTestFqdnHostnames-412725694-project-member] Enqueued Resource ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f with Priority: HIGHEST for action security_group_members [ 779.141015] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f with Priority: HIGHEST for action security_group_members [ 779.141499] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.141625] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.141771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.142129] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.142325] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.142445] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.142507] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.142674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.142794] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.142928] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1f09c79-4735-45a5-8af5-ec47fcc9b65f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.426997] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: SUCCESS [ 779.427291] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.427692] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.427692] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.427842] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.427958] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.428044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.428193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.428279] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.428405] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.646520] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.646738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.646795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.647122] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.648303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.648303] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.648303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.648303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.648303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.648303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.648303] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f already deleted. [ 779.648303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.933041] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.954465] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-186 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.954708] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-186" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.954850] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-186" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.955226] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-186" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.955543] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.955736] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.955884] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.956714] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.956904] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.957194] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.957325] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.957477] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.957552] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.957672] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.957783] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.957919] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.986317] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.986543] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 779.986668] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.986898] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-186" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.987293] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-dc1fe4fa-91c7-4752-9cad-680521aa9aa4 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.987478] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-dc1fe4fa-91c7-4752-9cad-680521aa9aa4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.987618] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-dc1fe4fa-91c7-4752-9cad-680521aa9aa4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.987977] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-dc1fe4fa-91c7-4752-9cad-680521aa9aa4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.988138] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc1fe4fa-91c7-4752-9cad-680521aa9aa4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.438359] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.491732] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.491732] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.491732] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.492115] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.492328] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.492556] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port dc1fe4fa-91c7-4752-9cad-680521aa9aa4 not found, creating... [ 780.492918] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.493102] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.493297] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.493624] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.493818] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.494460] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.494460] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.494603] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.494838] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.495047] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.495254] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: dc1fe4fa-91c7-4752-9cad-680521aa9aa4 is going to be created. [ 780.518052] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.518655] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.519031] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.519307] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.519630] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.519951] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-dc1fe4fa-91c7-4752-9cad-680521aa9aa4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.856663] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1db02b01-820f-4081-802a-12188735ffe1 in Status: SUCCESS [ 780.856949] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.940725] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.941481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.941481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.941481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.941481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.941481] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be updated. [ 780.972804] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.973027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.973094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.973347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.973549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.984013] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: IN_PROGRESS for 2s [ 781.365727] env[69343]: INFO networking_nsxv3.common.synchronization [req-8e347e57-8813-44bc-bc66-174ec6f61379 req-931180e1-c141-4751-8c92-a2b7b6fab9ca service nova] Enqueued Resource ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f with Priority: HIGHEST for action security_group_rules [ 781.365920] env[69343]: INFO networking_nsxv3.common.synchronization [req-8e347e57-8813-44bc-bc66-174ec6f61379 req-931180e1-c141-4751-8c92-a2b7b6fab9ca service nova] Enqueued Resource ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f with Priority: HIGHEST for action security_group_members [ 781.366071] env[69343]: INFO networking_nsxv3.common.synchronization [req-8e347e57-8813-44bc-bc66-174ec6f61379 req-931180e1-c141-4751-8c92-a2b7b6fab9ca service nova] Enqueued Resource ID: dc1fe4fa-91c7-4752-9cad-680521aa9aa4 with Priority: HIGHEST for action port [ 781.366307] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f with Priority: HIGHEST for action security_group_rules [ 781.366434] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f with Priority: HIGHEST for action security_group_members [ 781.366532] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc1fe4fa-91c7-4752-9cad-680521aa9aa4 with Priority: HIGHEST for action port [ 781.367325] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1f09c79-4735-45a5-8af5-ec47fcc9b65f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.367531] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.367646] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.367884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.368010] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1f09c79-4735-45a5-8af5-ec47fcc9b65f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.369978] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.370281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.370402] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.371204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.371204] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.371204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.371204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.371204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.371204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.371896] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1f09c79-4735-45a5-8af5-ec47fcc9b65f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.373236] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc1fe4fa-91c7-4752-9cad-680521aa9aa4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.375386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc1fe4fa-91c7-4752-9cad-680521aa9aa4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.375386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc1fe4fa-91c7-4752-9cad-680521aa9aa4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.375386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc1fe4fa-91c7-4752-9cad-680521aa9aa4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.375386] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc1fe4fa-91c7-4752-9cad-680521aa9aa4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.670665] env[69343]: INFO networking_nsxv3.common.synchronization [req-ed1b97ee-ce76-4ff9-abc6-f61d3b9335c5 req-ef065584-fd0d-457c-9a0e-d829f319992a tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 781.671148] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 781.671600] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.671798] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.672668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.672668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.672668] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.672859] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.672859] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.673144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.673224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.673315] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.870975] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.871296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.873711] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1f09c79-4735-45a5-8af5-ec47fcc9b65f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.875966] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc1fe4fa-91c7-4752-9cad-680521aa9aa4 with status ACTIVE [ 781.875966] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.876233] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.876904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.877185] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.877312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.877809] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.877941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.878023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.878344] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.878431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.878613] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.879340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.879453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.879653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.879753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.879916] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc1fe4fa-91c7-4752-9cad-680521aa9aa4 is going to be updated. [ 781.909935] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.909935] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.909935] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.910746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.910746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.910746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc1fe4fa-91c7-4752-9cad-680521aa9aa4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.065910] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-521 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.066344] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-521" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.066344] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-521" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.066539] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-521" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.066820] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.066981] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.067112] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.067343] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.067486] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.067691] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.067798] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.067911] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.068044] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.068154] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.068265] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.068402] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.092659] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.093026] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 782.093159] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.093426] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-521" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.093809] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-df027b31-66d5-4104-aa64-af761838b6b8 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.094073] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-df027b31-66d5-4104-aa64-af761838b6b8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.094256] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-df027b31-66d5-4104-aa64-af761838b6b8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.094668] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-df027b31-66d5-4104-aa64-af761838b6b8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.094913] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df027b31-66d5-4104-aa64-af761838b6b8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.176118] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.377057] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1f09c79-4735-45a5-8af5-ec47fcc9b65f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.598068] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.598420] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.598603] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.599141] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.599449] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.599689] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port df027b31-66d5-4104-aa64-af761838b6b8 not found, creating... [ 782.600084] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.600269] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.600529] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.600837] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.601034] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.601469] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.601677] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.601857] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.602148] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.602365] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.602588] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: df027b31-66d5-4104-aa64-af761838b6b8 is going to be created. [ 782.623925] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.624158] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.624310] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.624601] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.624850] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.625104] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-df027b31-66d5-4104-aa64-af761838b6b8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.678819] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.882100] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.882100] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.882100] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.882378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.882378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.882435] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f is going to be created. [ 782.914496] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.914741] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.914741] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.915044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.915305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.928037] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f in Status: UNINITIALIZED for 2s [ 783.000327] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: SUCCESS [ 783.000327] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.000668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.000968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.001370] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.001478] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.001553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.001824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.002509] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.002509] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.002509] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.003515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.003829] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.004101] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.004266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.004367] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.004632] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.004767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.004902] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.181624] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.181936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.181936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.182127] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.182363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.182363] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 783.213946] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.214209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.214209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.214828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.214951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.226064] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 783.349675] env[69343]: INFO networking_nsxv3.common.synchronization [req-ed1b97ee-ce76-4ff9-abc6-f61d3b9335c5 req-34ada56c-2aae-4942-90c4-94751398ccf4 service nova] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_rules [ 783.349920] env[69343]: INFO networking_nsxv3.common.synchronization [req-ed1b97ee-ce76-4ff9-abc6-f61d3b9335c5 req-34ada56c-2aae-4942-90c4-94751398ccf4 service nova] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 783.350125] env[69343]: INFO networking_nsxv3.common.synchronization [req-ed1b97ee-ce76-4ff9-abc6-f61d3b9335c5 req-34ada56c-2aae-4942-90c4-94751398ccf4 service nova] Enqueued Resource ID: df027b31-66d5-4104-aa64-af761838b6b8 with Priority: HIGHEST for action port [ 783.350727] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_rules [ 783.350876] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 783.350980] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df027b31-66d5-4104-aa64-af761838b6b8 with Priority: HIGHEST for action port [ 783.351539] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.351720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.351839] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.352157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.352252] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.353306] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.353461] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.353729] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-df027b31-66d5-4104-aa64-af761838b6b8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.353857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df027b31-66d5-4104-aa64-af761838b6b8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.353953] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df027b31-66d5-4104-aa64-af761838b6b8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.354214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df027b31-66d5-4104-aa64-af761838b6b8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.354309] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df027b31-66d5-4104-aa64-af761838b6b8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.506868] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.507109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.507346] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.856519] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.856686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.856869] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df027b31-66d5-4104-aa64-af761838b6b8 with status ACTIVE [ 783.857089] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.857219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.857294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.857503] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.857608] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.857786] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.857883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.857947] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.858137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.858211] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.858407] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.858498] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.858558] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.858750] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.858836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.859873] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df027b31-66d5-4104-aa64-af761838b6b8 is going to be updated. [ 783.886631] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.887623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.887623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.887623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.887623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.887623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df027b31-66d5-4104-aa64-af761838b6b8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.009698] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.274404] env[69343]: INFO networking_nsxv3.common.synchronization [req-95d6b30c-5f81-4d08-941c-6f456500ef0b req-030de95d-79bd-43d5-81cf-775bfe50703b tempest-ServersTestBootFromVolume-1350092508 tempest-ServersTestBootFromVolume-1350092508-project-member] Enqueued Resource ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf with Priority: HIGHEST for action security_group_members [ 784.275215] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf with Priority: HIGHEST for action security_group_members [ 784.275375] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-f65fedc2-bd86-4b46-8ea8-95f7086801cf taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.275526] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.275715] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.275857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.276039] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.276172] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.276252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.276442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.276573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.276750] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f65fedc2-bd86-4b46-8ea8-95f7086801cf',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.403870] env[69343]: INFO networking_nsxv3.common.synchronization [req-a334f915-3b68-4ab2-ab5d-81a95c26e3c8 req-70c2a6f9-4d25-4484-b9bb-9129a7400120 tempest-ImagesTestJSON-628353040 tempest-ImagesTestJSON-628353040-project-member] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 784.411059] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 784.411059] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.411059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.411059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.411059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.411059] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.411059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.411059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.411059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.411059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.411059] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.512969] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.512969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.512969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.513214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.513327] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.513532] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be updated. [ 784.551595] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.552325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.552627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.554020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.554020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.565515] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: IN_PROGRESS for 2s [ 784.779351] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.779588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.779663] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.780495] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.780495] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.780495] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.780495] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.780495] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.780776] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.780818] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.780949] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf is going to be updated. [ 784.830786] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.830786] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.830927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.831287] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.831520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.842313] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-308 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.842795] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.843028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.844558] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.845303] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.845566] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.845879] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.847231] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.847547] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.847889] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.848126] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 784.848313] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 784.848498] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 784.848701] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.848880] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 784.849094] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 784.851392] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf in Status: IN_PROGRESS for 2s [ 784.874057] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 784.874282] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 784.874472] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 784.874661] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.875091] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-c6563190-5573-40c6-928f-2cb3b97bc07a taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.875537] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-c6563190-5573-40c6-928f-2cb3b97bc07a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.875537] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-c6563190-5573-40c6-928f-2cb3b97bc07a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.878864] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-c6563190-5573-40c6-928f-2cb3b97bc07a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.878864] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6563190-5573-40c6-928f-2cb3b97bc07a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.916814] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.916814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.916814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.917994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.917994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.918575] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.918575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.918751] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.919294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.919294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.919294] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 784.942132] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f in Status: SUCCESS [ 784.942395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.942624] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.942959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.943211] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.943417] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.943507] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.943742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.943856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.943964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.944086] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1f09c79-4735-45a5-8af5-ec47fcc9b65f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.967189] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.967318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.967386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.967591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.967724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.982132] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 785.241125] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 785.241327] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.241525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.241743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.241965] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.242085] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.242138] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.242299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.242382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.242472] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.378702] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.378975] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.379091] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.379488] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.379679] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.379883] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port c6563190-5573-40c6-928f-2cb3b97bc07a not found, creating... [ 785.380182] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.380482] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.380625] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.381517] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.381517] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.381678] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.381767] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.381819] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.382358] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.382358] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.382358] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: c6563190-5573-40c6-928f-2cb3b97bc07a is going to be created. [ 785.407791] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.407791] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.408084] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.408298] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.408826] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.408826] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-c6563190-5573-40c6-928f-2cb3b97bc07a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.446895] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1f09c79-4735-45a5-8af5-ec47fcc9b65f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.745714] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.949911] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1f09c79-4735-45a5-8af5-ec47fcc9b65f: rpc.has_security_group_logging(os_id): False [ 785.970411] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.970411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.970411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.970411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.970411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.970411] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.970411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.970411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.970411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.970411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.970411] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f is going to be created. [ 786.036859] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.037014] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.037625] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.037625] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.037924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.053535] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f in Status: IN_PROGRESS for 2s [ 786.173411] env[69343]: INFO networking_nsxv3.common.synchronization [req-a334f915-3b68-4ab2-ab5d-81a95c26e3c8 req-64442320-b74f-4b13-8782-8dd8fbfb273e service nova] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_rules [ 786.173593] env[69343]: INFO networking_nsxv3.common.synchronization [req-a334f915-3b68-4ab2-ab5d-81a95c26e3c8 req-64442320-b74f-4b13-8782-8dd8fbfb273e service nova] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 786.173734] env[69343]: INFO networking_nsxv3.common.synchronization [req-a334f915-3b68-4ab2-ab5d-81a95c26e3c8 req-64442320-b74f-4b13-8782-8dd8fbfb273e service nova] Enqueued Resource ID: c6563190-5573-40c6-928f-2cb3b97bc07a with Priority: HIGHEST for action port [ 786.174352] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_rules [ 786.174490] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 786.174589] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6563190-5573-40c6-928f-2cb3b97bc07a with Priority: HIGHEST for action port [ 786.174864] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.174989] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.175548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.176088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.176088] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.177534] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.177805] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.178200] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6563190-5573-40c6-928f-2cb3b97bc07a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.178314] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6563190-5573-40c6-928f-2cb3b97bc07a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.178390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6563190-5573-40c6-928f-2cb3b97bc07a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.178625] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6563190-5573-40c6-928f-2cb3b97bc07a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.178741] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6563190-5573-40c6-928f-2cb3b97bc07a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.251258] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.580067] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: IN_PROGRESS for 4s [ 786.680738] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.681650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.688072] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6563190-5573-40c6-928f-2cb3b97bc07a with status ACTIVE [ 786.688072] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.688072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.688072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.688072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.688072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.688072] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.688072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.688072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.688072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.688072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.688072] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.688072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.688072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.689022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.689022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.689022] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6563190-5573-40c6-928f-2cb3b97bc07a is going to be updated. [ 786.722245] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.722387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.722462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.722747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.722866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.722995] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6563190-5573-40c6-928f-2cb3b97bc07a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.756687] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.756908] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.756980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.757178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.757266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.757763] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 786.799591] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.799835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.799835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.800075] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.800231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.811947] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 786.865990] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf in Status: SUCCESS [ 786.866264] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f65fedc2-bd86-4b46-8ea8-95f7086801cf deletion is rescheduled due to dependency. [ 786.867718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f65fedc2-bd86-4b46-8ea8-95f7086801cf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.996938] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 786.997179] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b deletion is rescheduled due to dependency. [ 786.997421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.997642] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.997812] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.998751] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.998751] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.998751] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.998751] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.998751] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.998994] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.202776] env[69343]: INFO networking_nsxv3.common.synchronization [req-2a87ec8c-f761-4613-847c-531178a750ec req-9e958b00-1280-4aea-96b0-1d6bb5e285ca tempest-ListServerFiltersTestJSON-1584999217 tempest-ListServerFiltersTestJSON-1584999217-project-member] Enqueued Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 787.204132] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 787.205191] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.205406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.205483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.205735] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.206490] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.206490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.206490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.206827] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.206827] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.206827] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.502237] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.562866] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-810 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.565022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-810" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.565022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-810" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.565022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-810" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.565022] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.565022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.565022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.565022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.565022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.565810] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 787.568601] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 787.568601] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 787.568601] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 787.568601] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 787.568601] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 787.568601] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 787.593063] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 787.593539] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 787.593539] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 787.593633] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-810" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.593900] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-95ad8d6c-8f08-4c0b-8767-70656a5abafb taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.594086] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-95ad8d6c-8f08-4c0b-8767-70656a5abafb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.594236] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-95ad8d6c-8f08-4c0b-8767-70656a5abafb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.594669] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-95ad8d6c-8f08-4c0b-8767-70656a5abafb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.595506] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95ad8d6c-8f08-4c0b-8767-70656a5abafb',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.709395] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.709395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.709604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.709688] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.709785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.709990] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.710148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.710199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.710336] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.710428] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.710524] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac5de742-586a-4eea-8d29-9efb080dd556 already deleted. [ 787.710661] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.005329] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.066680] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f in Status: SUCCESS [ 788.066945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.097775] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.098393] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.098552] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.099044] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.099372] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.099624] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 95ad8d6c-8f08-4c0b-8767-70656a5abafb not found, creating... [ 788.100231] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.100518] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.100760] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.101280] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.101667] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.102264] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.102465] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.102611] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.102891] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.103058] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.103275] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 95ad8d6c-8f08-4c0b-8767-70656a5abafb is going to be created. [ 788.127026] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.127496] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.129165] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.129165] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.129165] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.129165] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-95ad8d6c-8f08-4c0b-8767-70656a5abafb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.510072] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.510240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.510279] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.510642] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.510750] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.510861] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 788.545888] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.547473] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.547563] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.547830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.551030] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.564498] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 788.593198] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: SUCCESS [ 788.593198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.593198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.593198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.593198] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.593198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.593198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.593198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.593198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.594293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.595097] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.597514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.597514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.597514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.597514] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.597514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.597514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.597514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.597514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.597514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.597514] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.824810] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 788.825059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.825246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.825536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.825763] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.827186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.827186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.827186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.827186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.827186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.827186] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.962190] env[69343]: INFO networking_nsxv3.common.synchronization [req-2a87ec8c-f761-4613-847c-531178a750ec req-27f06ab9-c355-467e-bfa1-85ddfa3c4edc service nova] Enqueued Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_rules [ 788.962385] env[69343]: INFO networking_nsxv3.common.synchronization [req-2a87ec8c-f761-4613-847c-531178a750ec req-27f06ab9-c355-467e-bfa1-85ddfa3c4edc service nova] Enqueued Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 788.962599] env[69343]: INFO networking_nsxv3.common.synchronization [req-2a87ec8c-f761-4613-847c-531178a750ec req-27f06ab9-c355-467e-bfa1-85ddfa3c4edc service nova] Enqueued Resource ID: 95ad8d6c-8f08-4c0b-8767-70656a5abafb with Priority: HIGHEST for action port [ 788.965353] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_rules [ 788.965528] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 788.965648] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95ad8d6c-8f08-4c0b-8767-70656a5abafb with Priority: HIGHEST for action port [ 788.965984] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.966160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.966254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.967655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.967655] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.967655] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.967952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.967952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.968038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.968615] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.968731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.968807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.969040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.969122] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.969221] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.971597] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-95ad8d6c-8f08-4c0b-8767-70656a5abafb taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.971826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95ad8d6c-8f08-4c0b-8767-70656a5abafb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.971826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95ad8d6c-8f08-4c0b-8767-70656a5abafb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.972060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95ad8d6c-8f08-4c0b-8767-70656a5abafb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.972203] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95ad8d6c-8f08-4c0b-8767-70656a5abafb',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.100532] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77342b3e-c1bc-49a4-9f26-15de2bffefee: rpc.has_security_group_logging(os_id): False [ 789.122304] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.122609] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.122609] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.122803] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.122852] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.123095] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.123223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.123283] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.123494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.123560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.123699] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.123809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.123873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.124022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.124109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.124287] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.124379] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.124431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.124573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.124650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.124736] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be updated. [ 789.227550] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.227684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.227810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.227961] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.228119] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.249228] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: IN_PROGRESS for 2s [ 789.331561] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.331804] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.331804] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.332032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.332231] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.332340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.332420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.332632] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.332756] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.332869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.333056] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.333154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.333228] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.333381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.333546] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.333640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.333712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.333852] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.333929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.334591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.334742] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.474440] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.476753] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.476919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.477193] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95ad8d6c-8f08-4c0b-8767-70656a5abafb with status ACTIVE [ 789.477380] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.479421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.479421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.479421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.479421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.479421] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.479421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.479421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.480563] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.480563] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.480721] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.480781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.480828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.481819] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.481915] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.482053] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95ad8d6c-8f08-4c0b-8767-70656a5abafb is going to be updated. [ 789.508665] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.508899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.508945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.509179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.509630] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.509862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95ad8d6c-8f08-4c0b-8767-70656a5abafb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.837209] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40a389c1-84ea-4a8d-9f0b-0df3c555e73b: rpc.has_security_group_logging(os_id): False [ 789.856493] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.856725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.856800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.857066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.857224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.857921] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.857921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.857921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.857921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.857921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.858149] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.858149] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.858244] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.858318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.858390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.858611] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.859074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.859074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.859074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.859074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.859074] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 789.923706] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.923889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.923932] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.924199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.924354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.947159] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 789.978506] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.484388] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.484388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.484388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.484388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.484388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.484388] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac5de742-586a-4eea-8d29-9efb080dd556 is going to be created. [ 790.516374] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.516571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.516571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.516841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.517017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.535176] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: UNINITIALIZED for 2s [ 790.580841] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 4s [ 790.876425] env[69343]: INFO networking_nsxv3.common.synchronization [req-8b254348-8078-4ea3-a49a-27f601629b75 req-39267eb8-55a4-4f99-9b11-44d921265768 tempest-ServersTestMultiNic-93755808 tempest-ServersTestMultiNic-93755808-project-member] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 790.876425] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 790.877664] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.877816] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.877914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.878197] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.878390] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.878597] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.878679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.878918] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.879068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.879195] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.116032] env[69343]: INFO networking_nsxv3.common.synchronization [req-8b254348-8078-4ea3-a49a-27f601629b75 req-2a6f3653-a821-4be5-a8cb-c53fbfcf2349 tempest-ServersTestMultiNic-93755808 tempest-ServersTestMultiNic-93755808-project-member] Enqueued Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 791.116372] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee with Priority: HIGHEST for action security_group_members [ 791.116737] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-77342b3e-c1bc-49a4-9f26-15de2bffefee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.116893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.273496] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: SUCCESS [ 791.273674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.273898] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.274714] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.274714] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.382905] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.484717] env[69343]: INFO networking_nsxv3.common.synchronization [req-e70654b7-ec17-4b90-983b-79a880026a9e req-5d3de93f-2703-47e8-aa7e-29b6edb768fa tempest-ListServerFiltersTestJSON-1584999217 tempest-ListServerFiltersTestJSON-1584999217-project-member] Enqueued Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 791.485324] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 791.485651] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.486135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.815779] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.815779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.815779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.819106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.819106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.819106] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be deleted. [ 791.888236] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.909306] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.909458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.909713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.909825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.909910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.910088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.966511] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 791.966949] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.183650] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-810 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.183870] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-810" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.183970] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-810" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.184249] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-810" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.184510] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.184735] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.184787] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.184989] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.185153] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.185364] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.185479] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.185588] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.185693] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.185804] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.185908] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.186054] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.218974] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.219269] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 792.219420] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.220171] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-810" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.220678] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-88c79e4a-099e-47a3-bce4-274c5ebbd8af taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.221055] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-88c79e4a-099e-47a3-bce4-274c5ebbd8af" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.221472] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-88c79e4a-099e-47a3-bce4-274c5ebbd8af" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.225133] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-88c79e4a-099e-47a3-bce4-274c5ebbd8af" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.225133] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88c79e4a-099e-47a3-bce4-274c5ebbd8af',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.391565] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.391779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.391855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.392067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.392174] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.392276] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be updated. [ 792.435664] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.435957] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.436105] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.436435] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.436725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.463511] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: IN_PROGRESS for 2s [ 792.547744] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: SUCCESS [ 792.547967] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.548142] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.548648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.549051] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.549235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.549336] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.549536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.549622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.549713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.549864] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.551087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.551297] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.551503] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.551601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.551673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.551842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.551947] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.552101] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.593988] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 792.594370] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.594370] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.594620] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.594821] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.595217] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.595283] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.595467] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.595782] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.595905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.596012] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.731028] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.731028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.731028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.731028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.731028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.731028] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 88c79e4a-099e-47a3-bce4-274c5ebbd8af not found, creating... [ 792.731028] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.731028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.731028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.731028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.731028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.731982] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.731982] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.731982] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.731982] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.732722] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.733221] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 88c79e4a-099e-47a3-bce4-274c5ebbd8af is going to be created. [ 792.775277] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.775277] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.775277] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.775277] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.775277] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.775277] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-88c79e4a-099e-47a3-bce4-274c5ebbd8af" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.055371] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.056908] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.056908] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.101028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.101028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.101028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.101028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.101028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.101028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.101028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.101028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.101028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.101028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.101028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.101028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.101028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.101028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.101028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.101028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.101866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.101866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.101866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.101866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.101866] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.558248] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.607380] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47b39a17-6794-4f6b-b042-45a1e062090b: rpc.has_security_group_logging(os_id): False [ 793.630803] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.631012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.631092] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.631256] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.631368] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.631565] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.631708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.631708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.631887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.631979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.632333] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.632333] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.632457] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.632489] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.632567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.632788] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.632898] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.633194] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.633268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.633332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.633421] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 793.722307] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.722565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.722565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.722917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.723297] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.742828] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 794.064277] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.064627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.064627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.064726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.064825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.064942] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac5de742-586a-4eea-8d29-9efb080dd556 is going to be updated. [ 794.073354] env[69343]: INFO networking_nsxv3.common.synchronization [req-1682b827-b398-4c2d-9f89-249b7ebfea34 req-10a62f69-baca-4b6b-a130-c9a8c716b64c tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 with Priority: HIGHEST for action security_group_members [ 794.073522] env[69343]: INFO networking_nsxv3.common.synchronization [req-1682b827-b398-4c2d-9f89-249b7ebfea34 req-10a62f69-baca-4b6b-a130-c9a8c716b64c tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 794.074049] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 with Priority: HIGHEST for action security_group_members [ 794.074190] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 794.074464] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.074583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.074651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.074895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.078510] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.078510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.078510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.078734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.078734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.078840] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.080050] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.080359] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.080359] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.080772] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.081281] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.081396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.081456] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.081619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.081707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.081799] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.096064] env[69343]: INFO networking_nsxv3.common.synchronization [req-e70654b7-ec17-4b90-983b-79a880026a9e req-013b9f1a-abde-4103-ab46-76979c32a2ec service nova] Enqueued Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_rules [ 794.096064] env[69343]: INFO networking_nsxv3.common.synchronization [req-e70654b7-ec17-4b90-983b-79a880026a9e req-013b9f1a-abde-4103-ab46-76979c32a2ec service nova] Enqueued Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 794.096064] env[69343]: INFO networking_nsxv3.common.synchronization [req-e70654b7-ec17-4b90-983b-79a880026a9e req-013b9f1a-abde-4103-ab46-76979c32a2ec service nova] Enqueued Resource ID: 88c79e4a-099e-47a3-bce4-274c5ebbd8af with Priority: HIGHEST for action port [ 794.100047] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_rules [ 794.100047] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 794.100047] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88c79e4a-099e-47a3-bce4-274c5ebbd8af with Priority: HIGHEST for action port [ 794.100047] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.100047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.100047] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.100047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.100047] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-88c79e4a-099e-47a3-bce4-274c5ebbd8af taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.100047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88c79e4a-099e-47a3-bce4-274c5ebbd8af" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.100047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88c79e4a-099e-47a3-bce4-274c5ebbd8af" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.100774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88c79e4a-099e-47a3-bce4-274c5ebbd8af" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.100774] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88c79e4a-099e-47a3-bce4-274c5ebbd8af',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.105217] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.105377] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.105601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.105708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.105908] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.118856] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: IN_PROGRESS for 2s [ 794.167030] env[69343]: INFO networking_nsxv3.common.synchronization [req-1682b827-b398-4c2d-9f89-249b7ebfea34 req-10a62f69-baca-4b6b-a130-c9a8c716b64c tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 with Priority: HIGHEST for action security_group_rules [ 794.167030] env[69343]: INFO networking_nsxv3.common.synchronization [req-1682b827-b398-4c2d-9f89-249b7ebfea34 req-10a62f69-baca-4b6b-a130-c9a8c716b64c tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 with Priority: HIGHEST for action security_group_members [ 794.167030] env[69343]: INFO networking_nsxv3.common.synchronization [req-1682b827-b398-4c2d-9f89-249b7ebfea34 req-10a62f69-baca-4b6b-a130-c9a8c716b64c tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_rules [ 794.167030] env[69343]: INFO networking_nsxv3.common.synchronization [req-1682b827-b398-4c2d-9f89-249b7ebfea34 req-10a62f69-baca-4b6b-a130-c9a8c716b64c tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 794.167030] env[69343]: INFO networking_nsxv3.common.synchronization [req-1682b827-b398-4c2d-9f89-249b7ebfea34 req-10a62f69-baca-4b6b-a130-c9a8c716b64c tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: df027b31-66d5-4104-aa64-af761838b6b8 with Priority: HIGHEST for action port [ 794.170906] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 with Priority: HIGHEST for action security_group_rules [ 794.170906] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_rules [ 794.170906] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df027b31-66d5-4104-aa64-af761838b6b8 with Priority: HIGHEST for action port [ 794.170906] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 with Priority: HIGHEST for action security_group_members [ 794.170906] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 794.170906] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.170906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.170906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.170906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.170906] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.170906] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.173264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.173264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.173870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.173992] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.175617] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-df027b31-66d5-4104-aa64-af761838b6b8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.176923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df027b31-66d5-4104-aa64-af761838b6b8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.176923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df027b31-66d5-4104-aa64-af761838b6b8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.176923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df027b31-66d5-4104-aa64-af761838b6b8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.176923] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df027b31-66d5-4104-aa64-af761838b6b8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.177696] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.177943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.178184] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.178314] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.477922] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee in Status: SUCCESS [ 794.478408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.478590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.478914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.479248] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.479447] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.479574] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.479844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.479984] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.481090] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77342b3e-c1bc-49a4-9f26-15de2bffefee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.584090] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.585378] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.603333] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88c79e4a-099e-47a3-bce4-274c5ebbd8af with status ACTIVE [ 794.605121] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.605121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.605121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.605121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.605367] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.605479] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.610377] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.610431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.610914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.610914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.611460] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.612196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.612196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.612196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.612196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.612381] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88c79e4a-099e-47a3-bce4-274c5ebbd8af is going to be updated. [ 794.655791] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.655791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.655791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.655791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.655791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.655791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88c79e4a-099e-47a3-bce4-274c5ebbd8af" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.679857] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.680064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.680384] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.680569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.680843] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df027b31-66d5-4104-aa64-af761838b6b8 with status ACTIVE [ 794.681046] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.681164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.681251] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.681509] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.681616] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.681806] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.681949] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.682054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.682219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.682307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.682585] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.682709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.682811] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.682950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.683617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.683749] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df027b31-66d5-4104-aa64-af761838b6b8 is going to be updated. [ 794.723180] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.723180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.723180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.723180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.723180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.723180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df027b31-66d5-4104-aa64-af761838b6b8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.988024] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.988024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.988024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.988024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.988024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.988024] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.988024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.988024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.988024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.988024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.988024] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77342b3e-c1bc-49a4-9f26-15de2bffefee is going to be deleted. [ 795.065760] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.065760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.065760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.065760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.065760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.065760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77342b3e-c1bc-49a4-9f26-15de2bffefee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.089272] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.092905] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.592540] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.592714] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.592791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.592987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.593099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.593202] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 is going to be created. [ 795.594537] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.594680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.594732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.594878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.594962] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.595058] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 795.617767] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.618011] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.618011] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.618248] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.618431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.620816] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.620938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.621047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.621281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.621392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.628886] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 in Status: UNINITIALIZED for 2s [ 795.629621] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 795.768929] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 795.769235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.133103] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: SUCCESS [ 796.133863] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.134279] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.134580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.134821] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.135041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.135143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.135310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.135410] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.135534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.135758] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.135877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.135964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.136171] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.136357] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.136492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.136620] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.136793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.136929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.137145] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.137256] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.138497] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.138674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.138985] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.138985] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.138985] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.139625] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.139724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.139855] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.555961] env[69343]: INFO networking_nsxv3.common.synchronization [req-09770d47-e6ea-4c50-aca7-9e68d7af05f9 req-72de7a6b-92f0-4763-a781-dfca08fd3993 tempest-ListServerFiltersTestJSON-1584999217 tempest-ListServerFiltersTestJSON-1584999217-project-member] Enqueued Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 796.555961] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 796.555961] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.555961] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.644192] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.644192] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac5de742-586a-4eea-8d29-9efb080dd556: rpc.has_security_group_logging(os_id): False [ 796.666508] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.666718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.666785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.666988] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.667092] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.667299] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.667425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.667481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.667649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.667727] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.667933] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.668281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.668414] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.668546] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.668605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.668803] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.668889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.668959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.669758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.671235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.671349] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac5de742-586a-4eea-8d29-9efb080dd556 is going to be created. [ 796.745366] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.745529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.745581] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.745785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.746875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.768279] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: IN_PROGRESS for 2s [ 797.146809] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.303289] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-810 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.303514] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-810" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.306016] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-810" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.306506] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-810" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.306838] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.307027] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.307308] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.307615] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.307776] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.307998] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.308129] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.308235] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.308350] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.308448] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.308552] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.308692] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.344943] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.345732] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 797.345732] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.345873] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-810" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.346430] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-3226ccb7-234f-45b3-a40f-d75a32e54e28 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.346698] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-3226ccb7-234f-45b3-a40f-d75a32e54e28" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.346960] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-3226ccb7-234f-45b3-a40f-d75a32e54e28" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.348187] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-3226ccb7-234f-45b3-a40f-d75a32e54e28" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.348380] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3226ccb7-234f-45b3-a40f-d75a32e54e28',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.645180] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 797.645583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.646666] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 in Status: SUCCESS [ 797.647108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.647412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.647727] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.648532] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.648759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.648835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.649139] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.649266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.649387] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.650307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.651795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.652012] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.652147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.652211] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.652510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.652687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.652870] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.658027] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.658027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.658027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.658027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.658027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.658027] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac5de742-586a-4eea-8d29-9efb080dd556 is going to be updated. [ 797.703512] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.703512] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.703512] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.703824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.703990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.714647] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: IN_PROGRESS for 2s [ 797.851417] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.851417] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.851695] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.851836] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.852032] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.852290] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 3226ccb7-234f-45b3-a40f-d75a32e54e28 not found, creating... [ 797.852617] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.852816] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.852963] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.853292] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.853476] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.853836] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.854019] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.854140] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.854404] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.854577] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.854760] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 3226ccb7-234f-45b3-a40f-d75a32e54e28 is going to be created. [ 797.883072] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.883477] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.883724] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.884165] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.884438] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.884677] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-3226ccb7-234f-45b3-a40f-d75a32e54e28" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.156298] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.158360] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.645582] env[69343]: INFO networking_nsxv3.common.synchronization [req-09770d47-e6ea-4c50-aca7-9e68d7af05f9 req-a5068e15-c635-49d8-8374-83e64844b07c service nova] Enqueued Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_rules [ 798.645776] env[69343]: INFO networking_nsxv3.common.synchronization [req-09770d47-e6ea-4c50-aca7-9e68d7af05f9 req-a5068e15-c635-49d8-8374-83e64844b07c service nova] Enqueued Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 798.645991] env[69343]: INFO networking_nsxv3.common.synchronization [req-09770d47-e6ea-4c50-aca7-9e68d7af05f9 req-a5068e15-c635-49d8-8374-83e64844b07c service nova] Enqueued Resource ID: 3226ccb7-234f-45b3-a40f-d75a32e54e28 with Priority: HIGHEST for action port [ 798.646570] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_rules [ 798.646736] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 798.646854] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3226ccb7-234f-45b3-a40f-d75a32e54e28 with Priority: HIGHEST for action port [ 798.650199] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.650199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.650199] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.650199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.650199] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-3226ccb7-234f-45b3-a40f-d75a32e54e28 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.650199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3226ccb7-234f-45b3-a40f-d75a32e54e28" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.650199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3226ccb7-234f-45b3-a40f-d75a32e54e28" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.650199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3226ccb7-234f-45b3-a40f-d75a32e54e28" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.650199] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3226ccb7-234f-45b3-a40f-d75a32e54e28',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.659844] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.661217] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.782374] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: SUCCESS [ 798.782577] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.782828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.783099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.783197] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.107609] env[69343]: INFO networking_nsxv3.common.synchronization [req-3583bcab-8bf0-4801-af95-0a211cd0891c req-c19d3efd-a665-4d24-9d39-ff4f94472070 tempest-MultipleCreateTestJSON-1171017912 tempest-MultipleCreateTestJSON-1171017912-project-member] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 799.108359] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 799.108792] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.109025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.109125] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.109423] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.109678] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.109855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.109974] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.110255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.110403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.111380] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.153977] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3226ccb7-234f-45b3-a40f-d75a32e54e28 with status ACTIVE [ 799.153977] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.153977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.153977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.153977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.153977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.153977] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.153977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.153977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.153977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.153977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.153977] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.154694] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.154694] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.154694] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.154694] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.154694] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3226ccb7-234f-45b3-a40f-d75a32e54e28 is going to be updated. [ 799.167012] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.167290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.167290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.167473] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.167564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.167667] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 799.169629] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.170259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.170259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.170259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.170502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.170502] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 is going to be updated. [ 799.191521] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.191891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.191891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.192125] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.192183] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.192338] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3226ccb7-234f-45b3-a40f-d75a32e54e28" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.230743] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.231177] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.231177] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.231546] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.231779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.236729] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.236925] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.236976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.237200] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.237355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.246179] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 in Status: IN_PROGRESS for 2s [ 799.247950] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 799.285790] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.286090] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.484394] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-254 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.484602] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-254" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.484729] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-254" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.485009] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-254" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.485297] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.485440] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.485557] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.485767] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.485911] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.486131] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.486244] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.486601] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.486601] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.486601] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.486743] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.486829] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.552213] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.553040] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.066 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 799.553040] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.553302] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-254" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.553682] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-01b2a34b-f304-4afa-b769-54babffa386e taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.554886] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-01b2a34b-f304-4afa-b769-54babffa386e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.554886] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-01b2a34b-f304-4afa-b769-54babffa386e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.554886] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-01b2a34b-f304-4afa-b769-54babffa386e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.555104] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01b2a34b-f304-4afa-b769-54babffa386e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.615406] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.615599] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.615652] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.615857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.615948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.616176] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.616264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.616326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.616474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.616549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.616707] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 is going to be updated. [ 799.679074] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.679309] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.679354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.679622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.679826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.692049] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: IN_PROGRESS for 2s [ 799.726884] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: SUCCESS [ 799.727231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.727413] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.727680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.727896] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.728076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.728167] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.728366] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.728471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.728729] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.058478] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.058782] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.058844] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.059534] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.059534] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.059725] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 01b2a34b-f304-4afa-b769-54babffa386e not found, creating... [ 800.059945] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.060129] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.060279] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.060630] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.060911] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.061293] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.061544] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.061687] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.061958] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.062166] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.062399] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 01b2a34b-f304-4afa-b769-54babffa386e is going to be created. [ 800.083795] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.084296] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.084461] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.084663] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.084934] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.085371] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-01b2a34b-f304-4afa-b769-54babffa386e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.230801] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.733989] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.774909] env[69343]: INFO networking_nsxv3.common.synchronization [req-3583bcab-8bf0-4801-af95-0a211cd0891c req-75e21d48-8c97-4c0a-9423-10e765d7fce8 service nova] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_rules [ 800.774909] env[69343]: INFO networking_nsxv3.common.synchronization [req-3583bcab-8bf0-4801-af95-0a211cd0891c req-75e21d48-8c97-4c0a-9423-10e765d7fce8 service nova] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 800.774909] env[69343]: INFO networking_nsxv3.common.synchronization [req-3583bcab-8bf0-4801-af95-0a211cd0891c req-75e21d48-8c97-4c0a-9423-10e765d7fce8 service nova] Enqueued Resource ID: 01b2a34b-f304-4afa-b769-54babffa386e with Priority: HIGHEST for action port [ 800.778472] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_rules [ 800.778652] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 800.778759] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01b2a34b-f304-4afa-b769-54babffa386e with Priority: HIGHEST for action port [ 800.781405] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.781559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.781668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.781918] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.782015] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.783072] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.783169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.783461] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-01b2a34b-f304-4afa-b769-54babffa386e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.783569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01b2a34b-f304-4afa-b769-54babffa386e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.783610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01b2a34b-f304-4afa-b769-54babffa386e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.785379] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01b2a34b-f304-4afa-b769-54babffa386e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.785379] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01b2a34b-f304-4afa-b769-54babffa386e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.965167] env[69343]: INFO networking_nsxv3.common.synchronization [req-544a27ef-eb0e-4a87-acf4-5caa8569a280 req-17832a74-b792-4b6a-aed9-a3fb89f63aee tempest-ServersAdminTestJSON-624451732 tempest-ServersAdminTestJSON-624451732-project-member] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 800.965895] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 800.966322] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.966482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.966571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.966832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.967053] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.967182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.967274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.967480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.967604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.967734] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.236763] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.237164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.237164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.237164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.237379] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.237379] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac5de742-586a-4eea-8d29-9efb080dd556 is going to be updated. [ 801.256915] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 in Status: SUCCESS [ 801.257187] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.257419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.257757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.257987] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.258127] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.258197] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.258371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.258499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.258589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.258728] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.260410] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 801.260682] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.260850] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.261044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.261234] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.261387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.261484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.261689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.261780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.261869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.261959] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.273702] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.273875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.273913] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.274135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.274304] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.286430] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: IN_PROGRESS for 2s [ 801.286553] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.286714] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.286900] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01b2a34b-f304-4afa-b769-54babffa386e with status ACTIVE [ 801.287157] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.287357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.287406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.287699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.287787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.287953] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.288091] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.288145] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.288326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.288418] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.288619] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.288702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.288822] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.288927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.289009] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.289100] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01b2a34b-f304-4afa-b769-54babffa386e is going to be updated. [ 801.313226] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.313432] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.313496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.313675] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.313820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.314046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01b2a34b-f304-4afa-b769-54babffa386e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.471102] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.702573] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: SUCCESS [ 801.702820] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 deletion is rescheduled due to dependency. [ 801.702981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.703182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.703411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.703667] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.703836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.703917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.704094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.704177] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.704282] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.764169] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.765580] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.765760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.765806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.766032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.766209] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.766331] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.766397] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.766555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.766652] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.766763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.766946] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.767083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.767148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.767318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.767455] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.767658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.767658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.767772] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.768075] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.768075] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.768075] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.972469] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.206783] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.269439] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5: rpc.has_security_group_logging(os_id): False [ 802.270659] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40a389c1-84ea-4a8d-9f0b-0df3c555e73b: rpc.has_security_group_logging(os_id): False [ 802.288819] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.289090] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.289090] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.289601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.289601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.289701] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.289772] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.289818] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.290018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.290107] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.290203] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 is going to be created. [ 802.292060] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.292218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.292218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.292390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.292481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.292665] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.292755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.292815] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.292991] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.293082] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.293251] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.293350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.293413] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.293540] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.293603] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.293790] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.293884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.293941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.294079] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.294150] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.294232] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 802.394756] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.394976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.395068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.395227] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.395407] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.397452] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.397601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.397675] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.397859] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.398013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.422418] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 in Status: IN_PROGRESS for 2s [ 802.431056] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 802.476678] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.476678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.476678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.476678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.476678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.476678] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be updated. [ 802.548782] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.549114] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.549114] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.549311] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.549347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.560399] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: IN_PROGRESS for 2s [ 802.709013] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.786965] env[69343]: INFO networking_nsxv3.common.synchronization [req-3583bcab-8bf0-4801-af95-0a211cd0891c req-f203d466-5beb-484e-a431-ca39253ebcd0 tempest-MultipleCreateTestJSON-1171017912 tempest-MultipleCreateTestJSON-1171017912-project-member] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 802.787513] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 802.787814] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.787950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.114502] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-254 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.114730] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-254" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.115411] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-254" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.115411] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-254" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.115630] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.115814] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.115962] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.116310] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.116464] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.116732] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.116888] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 803.117011] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 803.117162] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 803.117284] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.117461] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 803.117640] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 803.150276] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 803.150497] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 803.150772] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 803.151335] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-254" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.151468] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-69673759-048d-4f7d-90f8-46d16a4c2c36 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.151744] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-69673759-048d-4f7d-90f8-46d16a4c2c36" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.151939] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-69673759-048d-4f7d-90f8-46d16a4c2c36" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.152296] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-69673759-048d-4f7d-90f8-46d16a4c2c36" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.152442] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69673759-048d-4f7d-90f8-46d16a4c2c36',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.212892] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.213146] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.213195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.213464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.213581] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.213702] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 is going to be updated. [ 803.250401] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.250401] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.250816] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.250883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.251043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.262019] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: IN_PROGRESS for 2s [ 803.303739] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: SUCCESS [ 803.304101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.304621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.304877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.305116] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.305244] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.305339] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.305521] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.305613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.305845] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.655423] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.655711] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.655779] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.656109] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.656264] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.656424] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 69673759-048d-4f7d-90f8-46d16a4c2c36 not found, creating... [ 803.656692] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.656850] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.656970] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.657214] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.657352] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.657663] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.657912] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.657967] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.658222] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.658378] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.658538] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 69673759-048d-4f7d-90f8-46d16a4c2c36 is going to be created. [ 803.693936] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.694286] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.694479] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.694871] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.695202] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.695501] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-69673759-048d-4f7d-90f8-46d16a4c2c36" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.807858] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.310692] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.437762] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 in Status: SUCCESS [ 804.437977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.448637] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 804.448886] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.571108] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: SUCCESS [ 804.571365] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.622022] env[69343]: INFO networking_nsxv3.common.synchronization [req-3583bcab-8bf0-4801-af95-0a211cd0891c req-a28a735c-2ac2-490f-8eb5-a0418d22cffe service nova] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_rules [ 804.622022] env[69343]: INFO networking_nsxv3.common.synchronization [req-3583bcab-8bf0-4801-af95-0a211cd0891c req-a28a735c-2ac2-490f-8eb5-a0418d22cffe service nova] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 804.622022] env[69343]: INFO networking_nsxv3.common.synchronization [req-3583bcab-8bf0-4801-af95-0a211cd0891c req-a28a735c-2ac2-490f-8eb5-a0418d22cffe service nova] Enqueued Resource ID: 69673759-048d-4f7d-90f8-46d16a4c2c36 with Priority: HIGHEST for action port [ 804.622022] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_rules [ 804.622022] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 804.622022] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69673759-048d-4f7d-90f8-46d16a4c2c36 with Priority: HIGHEST for action port [ 804.622022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.622022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.622022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.622022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.622022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-69673759-048d-4f7d-90f8-46d16a4c2c36 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.622795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69673759-048d-4f7d-90f8-46d16a4c2c36" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.622795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69673759-048d-4f7d-90f8-46d16a4c2c36" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.622795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69673759-048d-4f7d-90f8-46d16a4c2c36" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.622795] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69673759-048d-4f7d-90f8-46d16a4c2c36',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.813707] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.814078] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.814232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.814526] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.814687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.814863] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac5de742-586a-4eea-8d29-9efb080dd556 is going to be updated. [ 804.845347] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.845573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.845573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.845760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.845909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.854619] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: IN_PROGRESS for 2s [ 805.124601] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 69673759-048d-4f7d-90f8-46d16a4c2c36 with status ACTIVE [ 805.124965] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.125187] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.125302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.125624] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.125776] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.126057] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.126220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.126325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.126572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.126707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.126988] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.127156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.127258] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.127478] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.127601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.127875] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 69673759-048d-4f7d-90f8-46d16a4c2c36 is going to be updated. [ 805.150011] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.150173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.150289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.150513] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.150746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.151166] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69673759-048d-4f7d-90f8-46d16a4c2c36" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.272358] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: SUCCESS [ 805.272587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.272763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.273029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.273226] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.273343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.273410] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.273562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.273646] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.273733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.273831] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.274965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.275085] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.275242] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.275343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.275407] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.275583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.275645] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.275709] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.778189] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.778189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.778189] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.196310] env[69343]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 806.196509] env[69343]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] NSXv3 Agent Agent loop - iteration:1 started [ 806.280218] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.783486] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.783853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.783853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.784163] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.784210] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.784322] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 is going to be updated. [ 806.823199] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.823199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.823199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.823199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.823644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.833453] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: IN_PROGRESS for 2s [ 806.868168] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: SUCCESS [ 806.868618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.868891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.869160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.869417] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.869542] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.869605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.869741] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.869812] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.869903] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.869996] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.373304] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.373494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.373575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.373922] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.374203] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.374374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.374488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.374783] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.374955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.375132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.375395] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.375560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.375678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.375943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.377280] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.377402] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.377476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.377653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.377744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.377834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.377932] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.880706] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac5de742-586a-4eea-8d29-9efb080dd556: rpc.has_security_group_logging(os_id): False [ 807.903420] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.903613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.903613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.904104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.904207] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.904399] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.904693] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.904793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.904971] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.905122] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.905323] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.905423] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.905488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.905856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.905935] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.906175] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.906313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.906313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.906448] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.906572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.906628] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac5de742-586a-4eea-8d29-9efb080dd556 is going to be updated. [ 807.968139] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.968328] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.970091] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.970091] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.970091] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.982183] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: IN_PROGRESS for 2s [ 808.199239] env[69343]: INFO networking_nsxv3.common.synchronization [req-c991772b-d587-4ecc-8b6d-4e4fea3a5aae req-06855ae3-7415-4974-a56d-4e44dce7ef81 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 808.199494] env[69343]: INFO networking_nsxv3.common.synchronization [req-c991772b-d587-4ecc-8b6d-4e4fea3a5aae req-06855ae3-7415-4974-a56d-4e44dce7ef81 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 with Priority: HIGHEST for action security_group_members [ 808.199731] env[69343]: INFO networking_nsxv3.common.synchronization [req-c991772b-d587-4ecc-8b6d-4e4fea3a5aae req-06855ae3-7415-4974-a56d-4e44dce7ef81 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 with Priority: HIGHEST for action security_group_members [ 808.200478] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 808.200698] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 with Priority: HIGHEST for action security_group_members [ 808.200842] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 with Priority: HIGHEST for action security_group_members [ 808.201216] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.201380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.201479] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.201734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.201918] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.202123] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.202223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.202422] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.202543] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.202665] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.204672] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.204861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.207499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.207736] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.209191] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.209191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.209191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.209191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.209191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.209191] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.209631] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.210252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.210252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.210252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.210448] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.210448] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.210552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.210649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.210751] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.210812] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e19c4bb6-aab7-474e-8f6c-2786bebe2d24',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.304326] env[69343]: INFO networking_nsxv3.common.synchronization [req-c991772b-d587-4ecc-8b6d-4e4fea3a5aae req-06855ae3-7415-4974-a56d-4e44dce7ef81 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 with Priority: HIGHEST for action security_group_rules [ 808.304326] env[69343]: INFO networking_nsxv3.common.synchronization [req-c991772b-d587-4ecc-8b6d-4e4fea3a5aae req-06855ae3-7415-4974-a56d-4e44dce7ef81 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 with Priority: HIGHEST for action security_group_members [ 808.304326] env[69343]: INFO networking_nsxv3.common.synchronization [req-c991772b-d587-4ecc-8b6d-4e4fea3a5aae req-06855ae3-7415-4974-a56d-4e44dce7ef81 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_rules [ 808.304326] env[69343]: INFO networking_nsxv3.common.synchronization [req-c991772b-d587-4ecc-8b6d-4e4fea3a5aae req-06855ae3-7415-4974-a56d-4e44dce7ef81 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 808.304326] env[69343]: INFO networking_nsxv3.common.synchronization [req-c991772b-d587-4ecc-8b6d-4e4fea3a5aae req-06855ae3-7415-4974-a56d-4e44dce7ef81 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 with Priority: HIGHEST for action security_group_rules [ 808.304326] env[69343]: INFO networking_nsxv3.common.synchronization [req-c991772b-d587-4ecc-8b6d-4e4fea3a5aae req-06855ae3-7415-4974-a56d-4e44dce7ef81 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 with Priority: HIGHEST for action security_group_members [ 808.304326] env[69343]: INFO networking_nsxv3.common.synchronization [req-c991772b-d587-4ecc-8b6d-4e4fea3a5aae req-06855ae3-7415-4974-a56d-4e44dce7ef81 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: df027b31-66d5-4104-aa64-af761838b6b8 with Priority: HIGHEST for action port [ 808.304326] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 with Priority: HIGHEST for action security_group_rules [ 808.304326] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_rules [ 808.304326] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 with Priority: HIGHEST for action security_group_members [ 808.304326] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df027b31-66d5-4104-aa64-af761838b6b8 with Priority: HIGHEST for action port [ 808.304326] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 with Priority: HIGHEST for action security_group_rules [ 808.304326] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 with Priority: HIGHEST for action security_group_members [ 808.304326] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 808.304326] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.304830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.304830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.304830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.304913] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.305830] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.305974] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.306061] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.306256] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.306343] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.311672] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.311779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.312192] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-df027b31-66d5-4104-aa64-af761838b6b8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.312192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df027b31-66d5-4104-aa64-af761838b6b8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.312192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df027b31-66d5-4104-aa64-af761838b6b8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.312358] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df027b31-66d5-4104-aa64-af761838b6b8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.312358] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df027b31-66d5-4104-aa64-af761838b6b8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.313150] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e19c4bb6-aab7-474e-8f6c-2786bebe2d24 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.313258] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.313297] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.313486] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.313559] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e19c4bb6-aab7-474e-8f6c-2786bebe2d24',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.314960] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.314960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.316370] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.316370] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.714200] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.716305] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.716305] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e19c4bb6-aab7-474e-8f6c-2786bebe2d24',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.817498] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.819483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.819483] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.819483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.819483] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df027b31-66d5-4104-aa64-af761838b6b8 with status ACTIVE [ 808.819483] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.819483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.819483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.819483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.819939] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.819939] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.819939] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.820071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.820391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.820507] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.820823] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.820961] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.821129] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.821288] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.821463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.821559] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df027b31-66d5-4104-aa64-af761838b6b8 is going to be updated. [ 808.829985] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.830499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.857552] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: SUCCESS [ 808.857873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.858136] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.858451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.858725] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.858926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.859105] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.859246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.859362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.859498] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.867148] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.868893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.868893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.868893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.868893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.869169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df027b31-66d5-4104-aa64-af761838b6b8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.218228] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.223698] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e19c4bb6-aab7-474e-8f6c-2786bebe2d24',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.223698] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.366488] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.723564] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.723710] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.723770] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.724016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.724124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.724203] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 is going to be updated. [ 809.726135] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.726135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.726135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.726786] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.726786] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.726786] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 is going to be created. [ 809.730053] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.730210] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.730280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.730538] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.730538] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.731342] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 809.768923] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.769145] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.769145] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.769340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.769563] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.771901] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.772084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.772130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.772339] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.772480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.774159] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.774292] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.774331] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.775057] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.775057] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.785614] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 809.786653] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 in Status: IN_PROGRESS for 2s [ 809.787495] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 in Status: UNINITIALIZED for 2s [ 809.870724] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.002192] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: SUCCESS [ 810.003689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.003689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.003689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.003689] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.374809] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.374809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.374809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.374809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.374809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.375766] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 is going to be updated. [ 810.406541] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.406727] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.406765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.406979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.407149] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.420769] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: IN_PROGRESS for 2s [ 810.509858] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.509858] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.509858] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.510060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.510437] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.510437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.510437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.510437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.511146] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.511146] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.511146] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.996194] env[69343]: INFO networking_nsxv3.common.synchronization [req-1e865e3f-4034-4c29-aab3-cd497d5327ca req-6cfc78f0-788e-4acf-95e8-d0f0b1de1569 tempest-ServerDiskConfigTestJSON-1018188129 tempest-ServerDiskConfigTestJSON-1018188129-project-member] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 810.996194] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 810.996194] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.996194] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.996194] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.997112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.997497] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.997734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.997955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.998251] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.998516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.998736] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.018994] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.019153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.019222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.019437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.019596] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.019693] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.019766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.019917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.019999] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.020096] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.020238] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.020331] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.020385] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.021987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.021987] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.021987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.021987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.021987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.022221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.023100] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.023203] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.303193] env[69343]: INFO networking_nsxv3.common.synchronization [req-47ca5b86-53be-42cb-b03d-08499311c1e0 req-7d771048-a2e7-4412-bf49-2a3800b4905b tempest-ServersTestManualDisk-1820487143 tempest-ServersTestManualDisk-1820487143-project-member] Enqueued Resource ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 with Priority: HIGHEST for action security_group_members [ 811.303815] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 with Priority: HIGHEST for action security_group_members [ 811.304187] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-44259464-12d7-4ca0-9bd3-7620c5aac9c5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.304303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.304395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.304565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.304839] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.304960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.307130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.307130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.307130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.307130] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44259464-12d7-4ca0-9bd3-7620c5aac9c5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.501576] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.501911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.501911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.502049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.502131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.502339] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.502422] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.502473] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.503270] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.503270] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.503270] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 811.528801] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac5de742-586a-4eea-8d29-9efb080dd556: rpc.has_security_group_logging(os_id): False [ 811.540926] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.540926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.540926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.541181] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.541309] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.549313] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.549509] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.549555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.549798] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.550200] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.550200] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.550200] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.550429] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.550429] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.550539] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.550680] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.550778] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.550841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.550991] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.551099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.551283] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.551378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.551435] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.551610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.551610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.551742] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac5de742-586a-4eea-8d29-9efb080dd556 is going to be updated. [ 811.560221] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 811.643926] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.644763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.644763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.644763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.644763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.662036] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: IN_PROGRESS for 2s [ 811.816637] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 in Status: SUCCESS [ 811.816637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.816637] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 811.816637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.819049] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 in Status: SUCCESS [ 811.823833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.823833] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.823833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.823833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.823833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.823833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.823833] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.823833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.823833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.823833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.823833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.823833] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 is going to be updated. [ 811.824357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.825161] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.825430] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.826039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.826149] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.826371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.826495] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.826673] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e19c4bb6-aab7-474e-8f6c-2786bebe2d24',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.827654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.828060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.828126] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.828265] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.828353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.828541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.828663] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.828792] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.829670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.829862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.830618] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.830743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.830853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.831070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.831223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.831363] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.875656] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.875656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.875656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.875936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.876033] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.885657] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 in Status: IN_PROGRESS for 2s [ 812.333209] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e19c4bb6-aab7-474e-8f6c-2786bebe2d24',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.336235] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.337860] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.436657] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.436904] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.437230] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.437882] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.438229] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.438454] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.438670] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.438989] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.439165] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.439411] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.439526] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.439635] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.439770] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.440036] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.440036] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.440138] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.443777] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: SUCCESS [ 812.444825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.446170] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.446377] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.446722] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.446938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.447032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.447229] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.447322] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.447414] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.447620] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.447755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.447817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.447977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.448264] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.448449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.448574] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.448784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.448904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.448990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.449118] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.453594] env[69343]: INFO networking_nsxv3.common.synchronization [req-46c565d0-8118-41f6-b3bf-20554c3a1ce5 req-dcd86c97-c219-4566-8544-d8787c86a4e2 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 with Priority: HIGHEST for action security_group_members [ 812.453594] env[69343]: INFO networking_nsxv3.common.synchronization [req-46c565d0-8118-41f6-b3bf-20554c3a1ce5 req-dcd86c97-c219-4566-8544-d8787c86a4e2 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 812.453594] env[69343]: INFO networking_nsxv3.common.synchronization [req-46c565d0-8118-41f6-b3bf-20554c3a1ce5 req-dcd86c97-c219-4566-8544-d8787c86a4e2 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 with Priority: HIGHEST for action security_group_members [ 812.453594] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 with Priority: HIGHEST for action security_group_members [ 812.453740] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 812.453772] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 with Priority: HIGHEST for action security_group_members [ 812.454094] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.454209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.454407] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.454509] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.454706] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.454802] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.475176] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.475419] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 812.475629] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.475938] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.476392] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-7336145f-f3ff-4dea-b5f4-6aa885999ccf taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.476638] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-7336145f-f3ff-4dea-b5f4-6aa885999ccf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.476840] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-7336145f-f3ff-4dea-b5f4-6aa885999ccf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.477381] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-7336145f-f3ff-4dea-b5f4-6aa885999ccf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.477609] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7336145f-f3ff-4dea-b5f4-6aa885999ccf',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.837059] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e19c4bb6-aab7-474e-8f6c-2786bebe2d24',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.838736] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.840848] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.951685] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b7e2ff9-f297-4beb-8beb-6260aaac3c39: rpc.has_security_group_logging(os_id): False [ 812.969807] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.969989] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.969989] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.971102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.971102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.971102] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.971102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.971102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.971102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.971102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.971488] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.971488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.971488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.971488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.971621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.971776] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.971867] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.971921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.972099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.972261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.972261] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 is going to be updated. [ 812.981414] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.981657] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.981809] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.982076] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.982226] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.982406] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 7336145f-f3ff-4dea-b5f4-6aa885999ccf not found, creating... [ 812.982627] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.982780] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.982896] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.983135] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.983274] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.983633] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.983758] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.983810] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.984022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.985747] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.985747] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 7336145f-f3ff-4dea-b5f4-6aa885999ccf is going to be created. [ 813.001838] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.001838] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.002164] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.002336] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.002890] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.002890] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-7336145f-f3ff-4dea-b5f4-6aa885999ccf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.045876] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.046079] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.046181] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.046452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.046784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.062148] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: IN_PROGRESS for 2s [ 813.339510] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.339846] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.339925] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.340126] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.340256] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.340391] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 is going to be updated. [ 813.341940] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.344425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.344529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.349685] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.349806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.349933] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 813.351480] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.351618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.351683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.351895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.351997] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.352269] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 is going to be updated. [ 813.387320] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.387562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.387684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.387946] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.388140] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.394156] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.394156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.394156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.394156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.394156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.395638] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.395741] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.395843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.396055] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.396666] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.408554] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 in Status: IN_PROGRESS for 2s [ 813.409285] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 in Status: IN_PROGRESS for 2s [ 813.409867] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 813.483911] env[69343]: INFO networking_nsxv3.common.synchronization [None req-c343a88b-53c9-4474-b478-9b5e332d7af7 None None] Enqueued Resource ID: 5febd333-8d2b-4845-a62d-cacbb4477bf7 with Priority: HIGHEST for action port [ 813.485907] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5febd333-8d2b-4845-a62d-cacbb4477bf7 with Priority: HIGHEST for action port [ 813.485907] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-5febd333-8d2b-4845-a62d-cacbb4477bf7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.485907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5febd333-8d2b-4845-a62d-cacbb4477bf7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.485907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5febd333-8d2b-4845-a62d-cacbb4477bf7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.486405] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5febd333-8d2b-4845-a62d-cacbb4477bf7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.486405] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5febd333-8d2b-4845-a62d-cacbb4477bf7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.580781] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 4s [ 813.682815] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: SUCCESS [ 813.683121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.895537] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 in Status: SUCCESS [ 813.895847] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 deletion is rescheduled due to dependency. [ 813.896369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.993852] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5febd333-8d2b-4845-a62d-cacbb4477bf7 [ 813.994123] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.994287] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.994370] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.994627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.994734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.994814] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5febd333-8d2b-4845-a62d-cacbb4477bf7 already deleted. [ 813.994894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5febd333-8d2b-4845-a62d-cacbb4477bf7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.328114] env[69343]: INFO networking_nsxv3.common.synchronization [req-1e865e3f-4034-4c29-aab3-cd497d5327ca req-1cdd1eb4-28b6-40df-a1aa-0431fa7ca5cc service nova] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_rules [ 814.328324] env[69343]: INFO networking_nsxv3.common.synchronization [req-1e865e3f-4034-4c29-aab3-cd497d5327ca req-1cdd1eb4-28b6-40df-a1aa-0431fa7ca5cc service nova] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 814.328468] env[69343]: INFO networking_nsxv3.common.synchronization [req-1e865e3f-4034-4c29-aab3-cd497d5327ca req-1cdd1eb4-28b6-40df-a1aa-0431fa7ca5cc service nova] Enqueued Resource ID: 7336145f-f3ff-4dea-b5f4-6aa885999ccf with Priority: HIGHEST for action port [ 814.330081] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_rules [ 814.331338] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 814.331338] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7336145f-f3ff-4dea-b5f4-6aa885999ccf with Priority: HIGHEST for action port [ 814.331338] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.331338] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.331338] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.331338] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.331338] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.332202] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.332306] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.332501] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-7336145f-f3ff-4dea-b5f4-6aa885999ccf taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.332597] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7336145f-f3ff-4dea-b5f4-6aa885999ccf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.332663] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7336145f-f3ff-4dea-b5f4-6aa885999ccf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.334297] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7336145f-f3ff-4dea-b5f4-6aa885999ccf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.334297] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7336145f-f3ff-4dea-b5f4-6aa885999ccf',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.448763] env[69343]: INFO networking_nsxv3.common.synchronization [req-bdd192df-bc75-473e-9908-0624cec91498 req-60190ebd-e31d-493c-a641-43bc9b01bcae tempest-ServersAdminNegativeTestJSON-480893068 tempest-ServersAdminNegativeTestJSON-480893068-project-member] Enqueued Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGHEST for action security_group_members [ 814.449436] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGHEST for action security_group_members [ 814.449855] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.449980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.450617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.451017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.451124] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.451300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.451352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.451618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.451739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.451870] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.835935] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.836104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.836362] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7336145f-f3ff-4dea-b5f4-6aa885999ccf with status ACTIVE [ 814.836600] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.837093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.837093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.837241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.837241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.837459] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.837590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.837675] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.837874] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.837985] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.838249] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.838388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.838453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.838663] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.838758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.838874] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7336145f-f3ff-4dea-b5f4-6aa885999ccf is going to be updated. [ 814.865627] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.865627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.865627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.865839] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.866398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.866398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7336145f-f3ff-4dea-b5f4-6aa885999ccf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.954142] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.954504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.954504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.954697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.954809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.955059] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.955168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.955229] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.955394] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.955476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.955567] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39709bac-2d5f-45f1-8871-b8dc216058be already deleted. [ 814.955653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.081028] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: SUCCESS [ 815.081028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.082368] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.082368] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.082617] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.207548] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.207751] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.207895] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.210373] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.211047] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.211047] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.211178] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.211806] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.211806] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.211806] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 815.211963] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 815.212129] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 815.212410] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 815.212410] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 815.212512] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 815.214126] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 815.236054] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 815.236054] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 815.236054] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 815.236054] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.236054] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-46048e9d-6236-400d-ae95-6db4edfe886c taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.236506] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-46048e9d-6236-400d-ae95-6db4edfe886c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.236670] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-46048e9d-6236-400d-ae95-6db4edfe886c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.237198] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-46048e9d-6236-400d-ae95-6db4edfe886c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.237457] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46048e9d-6236-400d-ae95-6db4edfe886c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.426803] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 in Status: SUCCESS [ 815.427164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.427421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.427805] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.428097] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.428317] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.428440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.428911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.429212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.429452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.429772] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e19c4bb6-aab7-474e-8f6c-2786bebe2d24',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.431769] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 815.432237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.433349] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 in Status: SUCCESS [ 815.433795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.434228] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.434645] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.434967] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.435191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.435335] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.435612] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.435797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.435984] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e19c4bb6-aab7-474e-8f6c-2786bebe2d24',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.437141] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.437735] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.437917] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.438155] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.438290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.438548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.438714] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.439881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.439881] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.439881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.440120] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.440344] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.440446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.440508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.440754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.440854] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.440955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.441233] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.445058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.445156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.445292] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.445421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.445504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.445635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.445713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.445828] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.446683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.446794] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.447023] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.447138] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.447218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.447306] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.447587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.447587] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.588214] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.588464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.588464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.588698] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.588806] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.588955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.593155] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.593427] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.594408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.594408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.594408] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.595911] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 815.595911] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b deletion is rescheduled due to dependency. [ 815.596019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.596472] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.596672] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.597234] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.597234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.597234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.597234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.597234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.597533] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.741396] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.741815] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.741815] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.742141] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.742310] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.742466] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 46048e9d-6236-400d-ae95-6db4edfe886c not found, creating... [ 815.742722] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.742872] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.743010] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.743277] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.743471] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.743770] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.744810] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.745020] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.745485] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.745560] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.745715] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 46048e9d-6236-400d-ae95-6db4edfe886c is going to be created. [ 815.767575] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.768115] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.768263] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.768540] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.768818] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.769067] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-46048e9d-6236-400d-ae95-6db4edfe886c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.946679] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e19c4bb6-aab7-474e-8f6c-2786bebe2d24',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.948907] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.949098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.949168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.949332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.949422] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.949626] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.949726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.949791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.949942] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.950032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.950121] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 is going to be deleted. [ 815.953724] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.953900] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.954250] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.955799] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.957889] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.957889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.957889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.958073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.958125] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.958383] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.958383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.958502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.958746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.958746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.958746] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 is going to be updated. [ 815.985993] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.986160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.986231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.986439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.986577] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.991391] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.991534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.991583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.991785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.991873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.991974] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.996037] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 in Status: IN_PROGRESS for 2s [ 816.102028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.102028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.102028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.102028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.102028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.102028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.102028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.102028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.102028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.102028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.102028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.102028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.102028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.102028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.102028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.102028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.102656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.102656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.102656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.102656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.103309] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.105566] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.158463] env[69343]: INFO networking_nsxv3.common.synchronization [None req-a273754b-4bc7-4fa9-942b-336d98f756ed None None] Enqueued Resource ID: a859dc47-3125-4bfb-b95b-bcb8d301f387 with Priority: HIGHEST for action port [ 816.158463] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a859dc47-3125-4bfb-b95b-bcb8d301f387 with Priority: HIGHEST for action port [ 816.158463] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-a859dc47-3125-4bfb-b95b-bcb8d301f387 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.158463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a859dc47-3125-4bfb-b95b-bcb8d301f387" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.159221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a859dc47-3125-4bfb-b95b-bcb8d301f387" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.159866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a859dc47-3125-4bfb-b95b-bcb8d301f387" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.160120] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a859dc47-3125-4bfb-b95b-bcb8d301f387',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.449699] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e19c4bb6-aab7-474e-8f6c-2786bebe2d24: rpc.has_security_group_logging(os_id): False [ 816.466032] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5: rpc.has_security_group_logging(os_id): False [ 816.466032] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.474933] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.475388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.475477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.475732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.475837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.476096] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.476202] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.476274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.476461] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.476545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.476638] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 is going to be created. [ 816.487556] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.487556] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.487556] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.487765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.488533] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.489440] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.489440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.489440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.490374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.490374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.490374] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 is going to be updated. [ 816.497889] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e19c4bb6-aab7-474e-8f6c-2786bebe2d24], does not exist path=[/infra/domains/default/groups/e19c4bb6-aab7-474e-8f6c-2786bebe2d24]."\n}' [ 816.499166] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e19c4bb6-aab7-474e-8f6c-2786bebe2d24 [ 816.500091] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 816.539799] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.540793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.540793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.540793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.541799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.542184] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.542373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.542458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.542710] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.543161] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.543371] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.543629] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.543629] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.543901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.543901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.544080] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e19c4bb6-aab7-474e-8f6c-2786bebe2d24 is going to be created. [ 816.556915] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.556915] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.556915] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.557143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.557143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.573125] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 in Status: IN_PROGRESS for 2s [ 816.574766] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e19c4bb6-aab7-474e-8f6c-2786bebe2d24], does not exist path=[/infra/domains/default/groups/e19c4bb6-aab7-474e-8f6c-2786bebe2d24]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e19c4bb6-aab7-474e-8f6c-2786bebe2d24 [ 816.575052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e19c4bb6-aab7-474e-8f6c-2786bebe2d24" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.575473] env[69343]: Traceback (most recent call last): [ 816.575473] env[69343]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 816.575473] env[69343]: return func(*args, **kwargs) [ 816.575473] env[69343]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 816.575473] env[69343]: res.raise_for_status() [ 816.575473] env[69343]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 816.575473] env[69343]: raise HTTPError(http_error_msg, response=self) [ 816.575473] env[69343]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e19c4bb6-aab7-474e-8f6c-2786bebe2d24 [ 816.575473] env[69343]: During handling of the above exception, another exception occurred: [ 816.576809] env[69343]: Traceback (most recent call last): [ 816.576809] env[69343]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 816.576809] env[69343]: listener.cb(fileno) [ 816.576809] env[69343]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 816.576809] env[69343]: result = function(*args, **kwargs) [ 816.576809] env[69343]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 816.576809] env[69343]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 816.576809] env[69343]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 816.576809] env[69343]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 816.576809] env[69343]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 816.576809] env[69343]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 816.576809] env[69343]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 816.576809] env[69343]: res.raise_for_status() [ 816.576809] env[69343]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 816.576809] env[69343]: raise HTTPError(http_error_msg, response=self) [ 816.576809] env[69343]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e19c4bb6-aab7-474e-8f6c-2786bebe2d24 [ 816.576809] env[69343]: Removing descriptor: 22 [ 816.607225] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b7e2ff9-f297-4beb-8beb-6260aaac3c39: rpc.has_security_group_logging(os_id): False [ 816.608432] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.627447] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.627605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.627696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.627966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.662363] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a859dc47-3125-4bfb-b95b-bcb8d301f387 [ 816.662363] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.662692] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.662692] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.662777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.664106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.664106] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a859dc47-3125-4bfb-b95b-bcb8d301f387 already deleted. [ 816.664106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a859dc47-3125-4bfb-b95b-bcb8d301f387" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.665595] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.665595] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.665595] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.665595] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.665895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.665895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.666554] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.666554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.666554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.666554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.666554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.666835] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.666835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.666835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.667018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.667384] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.667525] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 is going to be updated. [ 816.746204] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.746375] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.746475] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.748127] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.748127] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.882710] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: IN_PROGRESS for 2s [ 816.969570] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.969990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.969990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.970083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.970150] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.970256] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 817.031028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.031028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.031028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.031028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.031028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.047107] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 817.110839] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.111611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.111755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.111994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.112119] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.112224] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 817.146803] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.151140] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.151345] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.151613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.151931] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.166200] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 817.431137] env[69343]: INFO networking_nsxv3.common.synchronization [req-bdd192df-bc75-473e-9908-0624cec91498 req-f234141c-5318-4cee-b8b6-de1a9b7421a7 service nova] Enqueued Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGHEST for action security_group_rules [ 817.431423] env[69343]: INFO networking_nsxv3.common.synchronization [req-bdd192df-bc75-473e-9908-0624cec91498 req-f234141c-5318-4cee-b8b6-de1a9b7421a7 service nova] Enqueued Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGHEST for action security_group_members [ 817.431695] env[69343]: INFO networking_nsxv3.common.synchronization [req-bdd192df-bc75-473e-9908-0624cec91498 req-f234141c-5318-4cee-b8b6-de1a9b7421a7 service nova] Enqueued Resource ID: 46048e9d-6236-400d-ae95-6db4edfe886c with Priority: HIGHEST for action port [ 817.432451] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGHEST for action security_group_rules [ 817.432694] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGHEST for action security_group_members [ 817.432889] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46048e9d-6236-400d-ae95-6db4edfe886c with Priority: HIGHEST for action port [ 817.433269] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.433776] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.433776] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.433776] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.433951] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.435182] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.435410] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.435410] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.436042] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.436376] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.436562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.436689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.436980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.437229] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.437913] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.438502] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-46048e9d-6236-400d-ae95-6db4edfe886c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.438682] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46048e9d-6236-400d-ae95-6db4edfe886c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.438682] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46048e9d-6236-400d-ae95-6db4edfe886c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.439094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46048e9d-6236-400d-ae95-6db4edfe886c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.439094] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46048e9d-6236-400d-ae95-6db4edfe886c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.940583] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.940796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.941048] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.941996] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46048e9d-6236-400d-ae95-6db4edfe886c with status ACTIVE [ 817.942228] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.942349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.942416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.942637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.942742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.943256] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.943256] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.943256] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.943588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.943588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.943588] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.943722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.943781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.943991] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.944682] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.944794] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46048e9d-6236-400d-ae95-6db4edfe886c is going to be updated. [ 817.970120] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.970592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.970592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.970592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.970867] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.971098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46048e9d-6236-400d-ae95-6db4edfe886c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.007592] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 in Status: SUCCESS [ 818.007592] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 deletion is rescheduled due to dependency. [ 818.007592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.447865] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.594064] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 in Status: SUCCESS [ 818.594064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.903069] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: SUCCESS [ 818.903297] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.951135] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.951281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.951318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.951527] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.951613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.951732] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39709bac-2d5f-45f1-8871-b8dc216058be is going to be created. [ 818.971095] env[69343]: INFO networking_nsxv3.common.synchronization [req-bf64dd1a-970c-4b15-abb4-0ec62d635000 req-09c49f31-eeb7-487e-bc7c-b581bf89c143 tempest-MultipleCreateTestJSON-1171017912 tempest-MultipleCreateTestJSON-1171017912-project-member] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 818.971383] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 818.971550] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.971634] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.971682] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.971981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.972068] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.972583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.972666] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.972853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.972938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.973047] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.977043] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.977154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.977221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.977395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.977549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.990159] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39709bac-2d5f-45f1-8871-b8dc216058be in Status: UNINITIALIZED for 2s [ 819.059987] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 819.059987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.060668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.061209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.061450] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.061606] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.061691] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.061899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.062033] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.062159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.062352] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.062519] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.062679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.062777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.062956] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.063129] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.063476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.063476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.063476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.063794] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.063794] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.176328] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 819.176565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.176863] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.177017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.177248] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.177371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.177437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.177601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.177683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.177766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.177941] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.241684] env[69343]: INFO networking_nsxv3.common.synchronization [req-f1e74ded-138b-4318-b8fa-33df816c067f req-115eebaf-bf73-4805-894f-c1673f5a1830 tempest-MultipleCreateTestJSON-1171017912 tempest-MultipleCreateTestJSON-1171017912-project-member] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 819.242338] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGHEST for action security_group_members [ 819.242667] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.242795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.263830] env[69343]: INFO networking_nsxv3.common.synchronization [req-5c609242-6423-4749-918c-4ccc12dde572 req-a2879476-dc9c-4eca-8f53-bb33c8223053 tempest-ServerActionsV293TestJSON-480392759 tempest-ServerActionsV293TestJSON-480392759-project-member] Enqueued Resource ID: b7614721-7a3e-40ba-83da-998503180bf3 with Priority: HIGHEST for action security_group_members [ 819.266854] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7614721-7a3e-40ba-83da-998503180bf3 with Priority: HIGHEST for action security_group_members [ 819.268749] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7614721-7a3e-40ba-83da-998503180bf3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.268749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.268749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.268749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.268749] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.268749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.268749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.268749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.268749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.268749] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7614721-7a3e-40ba-83da-998503180bf3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.476515] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.566486] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40a389c1-84ea-4a8d-9f0b-0df3c555e73b: rpc.has_security_group_logging(os_id): False [ 819.588025] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.588171] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.588237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.588494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.611407] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.611811] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.611951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.612167] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.612394] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.613358] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.614134] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.614245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.614371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.614582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.614618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.614828] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.614923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.614985] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.615152] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.616149] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.616149] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 819.680731] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.680939] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.681026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.681249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.681432] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.681561] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.681641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.681938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.681938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.682105] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.682199] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.682363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.682363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.682521] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.682610] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.682708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.682788] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.682916] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.683048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.683147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.683216] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.714494] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.714494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.714494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.714494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.714494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.759417] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 819.775629] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.775733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.775847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.779404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.779404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.779404] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.779404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.779404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.779404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.779404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.779404] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7614721-7a3e-40ba-83da-998503180bf3 already deleted. [ 819.779404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.936605] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.936804] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.936931] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.937251] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.937540] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.937702] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.937830] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.938471] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.938663] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.938883] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.938998] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.939129] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.939315] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.939412] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.939452] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.940371] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.962827] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.963399] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 819.963596] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.963845] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.964437] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-08c98ebe-24fd-410a-a0b2-1f0ba75d6be8 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.964667] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-08c98ebe-24fd-410a-a0b2-1f0ba75d6be8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.965189] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-08c98ebe-24fd-410a-a0b2-1f0ba75d6be8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.965576] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-08c98ebe-24fd-410a-a0b2-1f0ba75d6be8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.965735] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08c98ebe-24fd-410a-a0b2-1f0ba75d6be8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.981453] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.185305] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3973f86f-0821-4b7d-9e21-ccfe561c705b: rpc.has_security_group_logging(os_id): False [ 820.206548] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.206759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.206910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.207156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.229160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.229413] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.229530] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.229602] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.229864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.229952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.230164] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.230255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.230324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.230475] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.230551] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.231069] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.231069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.231214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.231307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.231396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.231487] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 820.319446] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.319591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.319711] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.319880] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.320045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.333723] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 820.471036] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.471036] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.471036] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.471036] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.471036] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.471036] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 08c98ebe-24fd-410a-a0b2-1f0ba75d6be8 not found, creating... [ 820.472588] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.473980] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.474232] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.474630] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.475978] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.476415] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.476651] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.478512] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.478512] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.478512] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.478512] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 08c98ebe-24fd-410a-a0b2-1f0ba75d6be8 is going to be created. [ 820.483763] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.484679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.484841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.485071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.485201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.485405] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 is going to be updated. [ 820.510307] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.510519] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.510646] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.511072] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.511385] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.511656] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-08c98ebe-24fd-410a-a0b2-1f0ba75d6be8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.522856] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.523072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.523072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.523295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.523489] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.534070] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: IN_PROGRESS for 2s [ 821.004875] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39709bac-2d5f-45f1-8871-b8dc216058be in Status: SUCCESS [ 821.005387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.005454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.005764] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.006092] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.006261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.006563] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.006691] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.006800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.006949] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.008045] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.510355] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.511023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.514080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.514080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.514080] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.514080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.514080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.514080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.514080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.514080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.514080] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.514080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.514080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.514080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.514080] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.514080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.514080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.514080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.514080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.514080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.514862] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.529783] env[69343]: INFO networking_nsxv3.common.synchronization [req-5c609242-6423-4749-918c-4ccc12dde572 req-5668d237-64fb-4bec-b5df-66828865da3e service nova] Enqueued Resource ID: b7614721-7a3e-40ba-83da-998503180bf3 with Priority: HIGHEST for action security_group_rules [ 821.532644] env[69343]: INFO networking_nsxv3.common.synchronization [req-5c609242-6423-4749-918c-4ccc12dde572 req-5668d237-64fb-4bec-b5df-66828865da3e service nova] Enqueued Resource ID: b7614721-7a3e-40ba-83da-998503180bf3 with Priority: HIGHEST for action security_group_members [ 821.532734] env[69343]: INFO networking_nsxv3.common.synchronization [req-5c609242-6423-4749-918c-4ccc12dde572 req-5668d237-64fb-4bec-b5df-66828865da3e service nova] Enqueued Resource ID: 08c98ebe-24fd-410a-a0b2-1f0ba75d6be8 with Priority: HIGHEST for action port [ 821.534204] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7614721-7a3e-40ba-83da-998503180bf3 with Priority: HIGHEST for action security_group_rules [ 821.534426] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7614721-7a3e-40ba-83da-998503180bf3 with Priority: HIGHEST for action security_group_members [ 821.534562] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08c98ebe-24fd-410a-a0b2-1f0ba75d6be8 with Priority: HIGHEST for action port [ 821.534938] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7614721-7a3e-40ba-83da-998503180bf3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.535202] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.535202] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.535401] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.535499] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7614721-7a3e-40ba-83da-998503180bf3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.538075] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7614721-7a3e-40ba-83da-998503180bf3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.538399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.538654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.539108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.539315] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.539431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.539624] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.540759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.540891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.541041] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7614721-7a3e-40ba-83da-998503180bf3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.543049] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-08c98ebe-24fd-410a-a0b2-1f0ba75d6be8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.543049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08c98ebe-24fd-410a-a0b2-1f0ba75d6be8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.543049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08c98ebe-24fd-410a-a0b2-1f0ba75d6be8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.543049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08c98ebe-24fd-410a-a0b2-1f0ba75d6be8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.543049] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08c98ebe-24fd-410a-a0b2-1f0ba75d6be8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.775860] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 821.776488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.020381] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39709bac-2d5f-45f1-8871-b8dc216058be: rpc.has_security_group_logging(os_id): False [ 822.038233] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7614721-7a3e-40ba-83da-998503180bf3 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.038392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.040954] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.041219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.041219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.043097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.043097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.043097] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.043097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.043097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.043097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.043097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.043097] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.043097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.044383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.044383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.044383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.044383] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.044383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.044592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.044592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.044673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.044757] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39709bac-2d5f-45f1-8871-b8dc216058be is going to be created. [ 822.046016] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b7614721-7a3e-40ba-83da-998503180bf3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.047704] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08c98ebe-24fd-410a-a0b2-1f0ba75d6be8 with status ACTIVE [ 822.047757] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.049372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.049372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.049372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.049372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.049372] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.049372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.049372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.049372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.049372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.049372] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.049372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.049372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.049372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.049372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.049372] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08c98ebe-24fd-410a-a0b2-1f0ba75d6be8 is going to be updated. [ 822.072776] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.072953] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.073076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.073307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.073469] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.076383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08c98ebe-24fd-410a-a0b2-1f0ba75d6be8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.120743] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.120743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.120743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.120979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.121139] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.136444] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39709bac-2d5f-45f1-8871-b8dc216058be in Status: IN_PROGRESS for 2s [ 822.356715] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 822.357674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.548271] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b7614721-7a3e-40ba-83da-998503180bf3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.553051] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: SUCCESS [ 822.553051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.553051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.553051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.553051] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.553051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.553810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.553810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.553917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.554109] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.052312] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.052653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.052653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.053051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.053051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.053051] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7614721-7a3e-40ba-83da-998503180bf3 is going to be created. [ 823.057588] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.057823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.058162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.058613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.058830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.059222] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.059439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.059890] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.060701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.060978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.061290] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 is going to be updated. [ 823.091733] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.092452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.092452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.093935] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.094186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.098522] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.098522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.098522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.098522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.098522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.112510] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: IN_PROGRESS for 2s [ 823.113248] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7614721-7a3e-40ba-83da-998503180bf3 in Status: UNINITIALIZED for 2s [ 824.161276] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39709bac-2d5f-45f1-8871-b8dc216058be in Status: SUCCESS [ 824.161276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.243727] env[69343]: INFO networking_nsxv3.common.synchronization [req-ced5bd97-10d1-47f1-af6c-a13552620a6d req-3ecadb76-98a8-484c-8c4a-4edb42005697 tempest-ListImageFiltersTestJSON-216247362 tempest-ListImageFiltersTestJSON-216247362-project-member] Enqueued Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGHEST for action security_group_members [ 824.248442] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGHEST for action security_group_members [ 824.249010] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-992f0e18-2006-4c90-ae32-07de7a98af22 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.249226] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.249340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.249639] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.249908] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.250170] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.250170] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.250458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.250591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.250760] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.754056] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.137032] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7614721-7a3e-40ba-83da-998503180bf3 in Status: SUCCESS [ 825.137032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.137032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.137032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.137032] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.137032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.137032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.137032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.137032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.137032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.137973] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b7614721-7a3e-40ba-83da-998503180bf3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.140737] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 in Status: SUCCESS [ 825.141882] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 deletion is rescheduled due to dependency. [ 825.141882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.258036] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.642565] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b7614721-7a3e-40ba-83da-998503180bf3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.763575] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.765370] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.765527] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.769020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.769020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.769020] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 992f0e18-2006-4c90-ae32-07de7a98af22 is going to be updated. [ 825.797327] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.797570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.797570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.797779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.797940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.810925] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 992f0e18-2006-4c90-ae32-07de7a98af22 in Status: IN_PROGRESS for 2s [ 825.826443] env[69343]: INFO networking_nsxv3.common.synchronization [req-bd92991f-9986-440c-bc77-e51f04fdf684 req-f86ca27a-de20-486a-9c7c-d89a843d5d39 tempest-ServerActionsTestOtherA-678333832 tempest-ServerActionsTestOtherA-678333832-project-member] Enqueued Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGHEST for action security_group_members [ 825.826443] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGHEST for action security_group_members [ 825.826964] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b63028d-55ab-4a15-b3eb-44ca69536be6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.827128] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.827182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.827659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.827885] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.827996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.828072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.828253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.828346] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.828446] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.146223] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b7614721-7a3e-40ba-83da-998503180bf3: rpc.has_security_group_logging(os_id): False [ 826.166858] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.167055] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.167101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.167369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.167467] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.167862] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.168031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.168077] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.168221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.168299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.168388] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7614721-7a3e-40ba-83da-998503180bf3 is going to be created. [ 826.232389] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.232619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.232619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.232818] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.235558] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.251208] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7614721-7a3e-40ba-83da-998503180bf3 in Status: IN_PROGRESS for 2s [ 826.251208] env[69343]: INFO networking_nsxv3.common.synchronization [None req-b5d5602d-f9d7-4012-a993-f06836b6e4d0 None None] Enqueued Resource ID: bef65d6f-3309-491a-9387-861e0ad34f2b with Priority: HIGHEST for action port [ 826.251208] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef65d6f-3309-491a-9387-861e0ad34f2b with Priority: HIGHEST for action port [ 826.253870] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-bef65d6f-3309-491a-9387-861e0ad34f2b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.254244] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bef65d6f-3309-491a-9387-861e0ad34f2b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.257038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bef65d6f-3309-491a-9387-861e0ad34f2b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.257038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bef65d6f-3309-491a-9387-861e0ad34f2b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.257038] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bef65d6f-3309-491a-9387-861e0ad34f2b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.332987] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.332987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.332987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.332987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.332987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.332987] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.332987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.332987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.332987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.332987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.332987] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 already deleted. [ 826.333887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.386253] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-184 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.386253] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.386253] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.386253] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.386253] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.386253] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.386253] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.387497] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.387873] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.388283] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 826.388387] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 826.388937] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 826.388937] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 826.388937] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 826.388937] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 826.389343] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 826.416385] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 826.416385] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 826.416385] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 826.416385] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.416385] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-2d4c8c69-a493-4e59-b809-1d5ac6265605 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.416385] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-2d4c8c69-a493-4e59-b809-1d5ac6265605" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.416385] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-2d4c8c69-a493-4e59-b809-1d5ac6265605" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.416385] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-2d4c8c69-a493-4e59-b809-1d5ac6265605" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.416385] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d4c8c69-a493-4e59-b809-1d5ac6265605',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.761968] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bef65d6f-3309-491a-9387-861e0ad34f2b [ 826.761968] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.761968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.761968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.762324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.763083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.763083] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bef65d6f-3309-491a-9387-861e0ad34f2b already deleted. [ 826.763083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bef65d6f-3309-491a-9387-861e0ad34f2b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.920151] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.920494] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.920679] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.920996] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.921486] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.921486] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 2d4c8c69-a493-4e59-b809-1d5ac6265605 not found, creating... [ 826.921796] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.921796] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.921917] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.922186] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.922295] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.923219] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.923219] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.923219] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.925715] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.925715] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.925715] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 2d4c8c69-a493-4e59-b809-1d5ac6265605 is going to be created. [ 826.951981] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.952663] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.952799] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.953175] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.953496] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.953898] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-2d4c8c69-a493-4e59-b809-1d5ac6265605" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.822598] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 992f0e18-2006-4c90-ae32-07de7a98af22 in Status: SUCCESS [ 827.823239] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.843693] env[69343]: INFO networking_nsxv3.common.synchronization [req-bd92991f-9986-440c-bc77-e51f04fdf684 req-85b61a41-e4c9-42f7-bb48-718023f0ef67 service nova] Enqueued Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGHEST for action security_group_rules [ 827.843898] env[69343]: INFO networking_nsxv3.common.synchronization [req-bd92991f-9986-440c-bc77-e51f04fdf684 req-85b61a41-e4c9-42f7-bb48-718023f0ef67 service nova] Enqueued Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGHEST for action security_group_members [ 827.844067] env[69343]: INFO networking_nsxv3.common.synchronization [req-bd92991f-9986-440c-bc77-e51f04fdf684 req-85b61a41-e4c9-42f7-bb48-718023f0ef67 service nova] Enqueued Resource ID: 2d4c8c69-a493-4e59-b809-1d5ac6265605 with Priority: HIGHEST for action port [ 827.844705] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGHEST for action security_group_rules [ 827.844837] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGHEST for action security_group_members [ 827.844961] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d4c8c69-a493-4e59-b809-1d5ac6265605 with Priority: HIGHEST for action port [ 827.845250] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b63028d-55ab-4a15-b3eb-44ca69536be6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.846153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.846153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.846153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.846153] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.847131] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b63028d-55ab-4a15-b3eb-44ca69536be6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.847131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.847131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.847131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.847492] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.847492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.847492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.847635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.847668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.847765] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.852929] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d4c8c69-a493-4e59-b809-1d5ac6265605 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.853332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d4c8c69-a493-4e59-b809-1d5ac6265605" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.853332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d4c8c69-a493-4e59-b809-1d5ac6265605" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.853799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d4c8c69-a493-4e59-b809-1d5ac6265605" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.853799] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d4c8c69-a493-4e59-b809-1d5ac6265605',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.923195] env[69343]: INFO networking_nsxv3.common.synchronization [None req-add1f744-7ec6-4f35-be71-94872a1788d2 tempest-AttachVolumeNegativeTest-1961671669 tempest-AttachVolumeNegativeTest-1961671669-project-member] Enqueued Resource ID: dec2bd26-cf02-479f-bf2c-2ca399054600 with Priority: HIGHEST for action security_group_rules [ 827.923195] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dec2bd26-cf02-479f-bf2c-2ca399054600 with Priority: HIGHEST for action security_group_rules [ 827.923195] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dec2bd26-cf02-479f-bf2c-2ca399054600 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.923195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.923195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.923721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.923974] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dec2bd26-cf02-479f-bf2c-2ca399054600',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.061261] env[69343]: INFO networking_nsxv3.common.synchronization [None req-d622daf6-08c8-412b-ba0f-291468413c22 tempest-AttachVolumeNegativeTest-1961671669 tempest-AttachVolumeNegativeTest-1961671669-project-member] Enqueued Resource ID: dec2bd26-cf02-479f-bf2c-2ca399054600 with Priority: HIGHEST for action security_group_rules [ 828.063085] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dec2bd26-cf02-479f-bf2c-2ca399054600 with Priority: HIGHEST for action security_group_rules [ 828.063798] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dec2bd26-cf02-479f-bf2c-2ca399054600 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.063798] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.264274] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7614721-7a3e-40ba-83da-998503180bf3 in Status: SUCCESS [ 828.265009] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.355527] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b63028d-55ab-4a15-b3eb-44ca69536be6 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.355697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.355921] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.357860] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d4c8c69-a493-4e59-b809-1d5ac6265605 with status ACTIVE [ 828.357860] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.357860] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.357860] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.357860] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.357860] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.357860] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.357860] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.357860] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.358327] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.358327] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.358327] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.358441] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.358488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.358752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.358752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.358752] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d4c8c69-a493-4e59-b809-1d5ac6265605 is going to be updated. [ 828.384054] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.384054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.384054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.384396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.384548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.384637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d4c8c69-a493-4e59-b809-1d5ac6265605" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.396839] env[69343]: INFO networking_nsxv3.common.synchronization [None req-2c30dc51-2796-40f7-b380-b095c89523b4 None None] Enqueued Resource ID: fcb732d5-4082-4317-8dc5-1ab173434441 with Priority: HIGHEST for action port [ 828.397031] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcb732d5-4082-4317-8dc5-1ab173434441 with Priority: HIGHEST for action port [ 828.398351] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcb732d5-4082-4317-8dc5-1ab173434441 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.398351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcb732d5-4082-4317-8dc5-1ab173434441" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.398351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcb732d5-4082-4317-8dc5-1ab173434441" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.398351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcb732d5-4082-4317-8dc5-1ab173434441" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.398351] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcb732d5-4082-4317-8dc5-1ab173434441',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.448747] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.448747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.448954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.449275] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.449275] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.449275] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dec2bd26-cf02-479f-bf2c-2ca399054600 already deleted. [ 828.449412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.449884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.449967] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.450129] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dec2bd26-cf02-479f-bf2c-2ca399054600',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.861353] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.900579] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fcb732d5-4082-4317-8dc5-1ab173434441 [ 828.900939] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.901111] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.901198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.901440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.901534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.901668] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fcb732d5-4082-4317-8dc5-1ab173434441 already deleted. [ 828.901824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcb732d5-4082-4317-8dc5-1ab173434441" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.973772] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.973964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.974045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.974247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.974345] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.974454] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dec2bd26-cf02-479f-bf2c-2ca399054600 already deleted. [ 828.974536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.366608] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.366608] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.366608] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.366812] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.366812] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.366905] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 is going to be created. [ 829.396937] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.397204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.397321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.397610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.397834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.410227] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 in Status: UNINITIALIZED for 2s [ 831.425551] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 in Status: SUCCESS [ 831.425551] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.425924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.425987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.426800] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.426800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.426800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.426800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.426800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.426800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.426800] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.929083] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b63028d-55ab-4a15-b3eb-44ca69536be6 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.931178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.931178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.931178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.931178] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.931178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.931178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.931178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.931178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.931178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.931178] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b63028d-55ab-4a15-b3eb-44ca69536be6 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.931178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.931178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.931178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.931178] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.931178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.931178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.931702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.931702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.931702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.931702] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.438545] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b63028d-55ab-4a15-b3eb-44ca69536be6: rpc.has_security_group_logging(os_id): False [ 832.460366] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.460633] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.460752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.461150] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.461387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.461762] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.461941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.462063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.462383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.462557] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.463228] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.463228] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.463337] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.463562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.463728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.464033] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.464150] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.464203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.464443] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.464535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.464607] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 is going to be created. [ 832.547051] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.547051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.547051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.547051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.547051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.572530] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 in Status: IN_PROGRESS for 2s [ 833.398472] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 833.398652] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 833.495412] env[69343]: INFO networking_nsxv3.common.synchronization [req-09d8d502-e343-44ba-8511-da34640f511f req-1d03d205-de8d-4859-8e2c-0366941f9ed2 tempest-ServersAdminTestJSON-624451732 tempest-ServersAdminTestJSON-624451732-project-member] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 833.496069] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 833.496250] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.496378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.496694] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.497035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.497209] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.497314] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.497371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.497525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.497610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.497704] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.004065] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.361026] env[69343]: INFO networking_nsxv3.common.synchronization [req-9a2e9a3f-c128-4d1a-8eba-75142e0ffb8e req-d68e7fd1-fe95-4fef-8211-7fd1023528da tempest-ServersTestFqdnHostnames-412725694 tempest-ServersTestFqdnHostnames-412725694-project-member] Enqueued Resource ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f with Priority: HIGHEST for action security_group_members [ 834.361026] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f with Priority: HIGHEST for action security_group_members [ 834.361725] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.362083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.362264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.362560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.364402] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.364402] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.364402] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.364402] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.364402] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.364402] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1f09c79-4735-45a5-8af5-ec47fcc9b65f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.506841] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.587973] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 in Status: SUCCESS [ 834.589921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.868620] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.868620] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.868620] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.868620] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.892707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.893572] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.894062] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.894738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.894738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.895709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.898100] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f is going to be updated. [ 834.928961] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.928961] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.928961] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.928961] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.929323] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.941861] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f in Status: IN_PROGRESS for 2s [ 835.009613] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.009808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.009861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.010081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.010745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.010880] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be updated. [ 835.069271] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.069271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.069271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.069271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.069271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.081046] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: IN_PROGRESS for 2s [ 836.952123] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f in Status: SUCCESS [ 836.952449] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1f09c79-4735-45a5-8af5-ec47fcc9b65f deletion is rescheduled due to dependency. [ 836.952449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1f09c79-4735-45a5-8af5-ec47fcc9b65f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.092946] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: SUCCESS [ 837.093195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.594720] env[69343]: INFO networking_nsxv3.common.synchronization [req-6b30d20d-7c8a-4906-814b-beae57615f78 req-733ed97b-2fc5-4888-9fb5-0d8d6483fe29 tempest-ServersTestJSON-245111932 tempest-ServersTestJSON-245111932-project-member] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 837.595300] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 837.595600] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.595722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.596282] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.600182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.600443] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.600588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.600682] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.600984] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.601051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.601137] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.103066] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.103437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.103437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.103625] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.103748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.107064] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.107064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.107064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.107064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.107064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.107064] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 already deleted. [ 838.107064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.179228] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.179430] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.179571] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.179890] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.180160] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.180318] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.180436] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.180646] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.180787] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.181037] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 838.181159] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 838.181269] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 838.181376] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 838.181488] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 838.181623] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 838.181764] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 838.201243] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 838.201413] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 838.201586] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.201776] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.202277] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-d837e918-5b85-4215-b408-06de41e19ef7 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.202511] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-d837e918-5b85-4215-b408-06de41e19ef7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.202675] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-d837e918-5b85-4215-b408-06de41e19ef7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.203032] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-d837e918-5b85-4215-b408-06de41e19ef7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.203320] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d837e918-5b85-4215-b408-06de41e19ef7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.707114] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.707407] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.707543] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.707833] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.707998] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.708166] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port d837e918-5b85-4215-b408-06de41e19ef7 not found, creating... [ 838.708443] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.708596] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.708716] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.708960] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.709109] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.709424] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.709574] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.709697] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.709930] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.710131] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.710265] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: d837e918-5b85-4215-b408-06de41e19ef7 is going to be created. [ 838.733970] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.734181] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.734303] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.734612] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.734850] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.735102] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-d837e918-5b85-4215-b408-06de41e19ef7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.183388] env[69343]: INFO networking_nsxv3.common.synchronization [None req-682f3ecc-6233-493d-965c-571c77a8f91b None None] Enqueued Resource ID: be11904c-6e27-45b6-8eca-989b8952ad61 with Priority: HIGHEST for action port [ 839.183388] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be11904c-6e27-45b6-8eca-989b8952ad61 with Priority: HIGHEST for action port [ 839.183388] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-be11904c-6e27-45b6-8eca-989b8952ad61 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.183388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be11904c-6e27-45b6-8eca-989b8952ad61" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.183388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be11904c-6e27-45b6-8eca-989b8952ad61" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.183388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be11904c-6e27-45b6-8eca-989b8952ad61" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.183388] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be11904c-6e27-45b6-8eca-989b8952ad61',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.255357] env[69343]: INFO networking_nsxv3.common.synchronization [req-df9d7e67-c86f-444f-9a0a-84ccde1e68eb req-d0354de9-6fa2-4589-a678-825739e0a775 tempest-ServerDiskConfigTestJSON-1018188129 tempest-ServerDiskConfigTestJSON-1018188129-project-member] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 839.255357] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 839.256137] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.256466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.256667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.257016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.257321] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.257571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.257786] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.258144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.258380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.259047] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.684161] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be11904c-6e27-45b6-8eca-989b8952ad61 [ 839.685031] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.685031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.685031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.685031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.685031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.685031] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be11904c-6e27-45b6-8eca-989b8952ad61 already deleted. [ 839.685421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be11904c-6e27-45b6-8eca-989b8952ad61" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.761863] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.762214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.762302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.762531] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.762623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.762843] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.762938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.763025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.763300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.763385] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.763483] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 839.798548] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.798893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.798893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.799065] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.800056] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.816539] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 839.967261] env[69343]: INFO networking_nsxv3.common.synchronization [req-8abb2de8-cddc-4c69-9188-863d457c8b58 req-5bd4c4e6-30d7-4bd1-95ee-aaf537f4f9af tempest-ListServerFiltersTestJSON-1584999217 tempest-ListServerFiltersTestJSON-1584999217-project-member] Enqueued Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 839.967261] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 839.967261] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.967520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.967520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.968311] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.968311] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.968311] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.968311] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.968638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.968638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.968758] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.050061] env[69343]: INFO networking_nsxv3.common.synchronization [req-b2281bb5-9a2b-4a11-9f98-919b45ad0a31 req-57b96f37-f7f4-4826-8a81-13660baef6b3 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f with Priority: HIGHEST for action security_group_members [ 840.050515] env[69343]: INFO networking_nsxv3.common.synchronization [req-b2281bb5-9a2b-4a11-9f98-919b45ad0a31 req-57b96f37-f7f4-4826-8a81-13660baef6b3 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 with Priority: HIGHEST for action security_group_members [ 840.050669] env[69343]: INFO networking_nsxv3.common.synchronization [req-b2281bb5-9a2b-4a11-9f98-919b45ad0a31 req-57b96f37-f7f4-4826-8a81-13660baef6b3 tempest-SecurityGroupsTestJSON-527285594 tempest-SecurityGroupsTestJSON-527285594-project-member] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 840.051828] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f with Priority: HIGHEST for action security_group_members [ 840.052260] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 with Priority: HIGHEST for action security_group_members [ 840.052260] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGHEST for action security_group_members [ 840.052405] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4923a56f-6f82-4449-82ab-38fbf0c7542f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.052560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.052690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.052892] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.053079] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.053363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.053464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.053800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.053800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.053893] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4923a56f-6f82-4449-82ab-38fbf0c7542f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.055071] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.055187] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.055229] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.055442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.055556] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.055658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.055721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.055905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.055992] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.056117] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.057128] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.057475] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.057475] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.057572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.058190] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.058190] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.058190] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.058190] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.058190] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.058190] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.193293] env[69343]: INFO networking_nsxv3.common.synchronization [req-6b30d20d-7c8a-4906-814b-beae57615f78 req-68781488-9af7-4c0f-b3e4-13717390da83 service nova] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_rules [ 840.193293] env[69343]: INFO networking_nsxv3.common.synchronization [req-6b30d20d-7c8a-4906-814b-beae57615f78 req-68781488-9af7-4c0f-b3e4-13717390da83 service nova] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 840.193293] env[69343]: INFO networking_nsxv3.common.synchronization [req-6b30d20d-7c8a-4906-814b-beae57615f78 req-68781488-9af7-4c0f-b3e4-13717390da83 service nova] Enqueued Resource ID: d837e918-5b85-4215-b408-06de41e19ef7 with Priority: HIGHEST for action port [ 840.193293] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_rules [ 840.193293] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 840.193293] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d837e918-5b85-4215-b408-06de41e19ef7 with Priority: HIGHEST for action port [ 840.196536] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.196757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.196858] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.200290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.200290] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.203332] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.203463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.204163] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.204557] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.204988] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.204988] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.204988] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.205337] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.205337] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.205337] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.206282] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-d837e918-5b85-4215-b408-06de41e19ef7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.206453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d837e918-5b85-4215-b408-06de41e19ef7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.206488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d837e918-5b85-4215-b408-06de41e19ef7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.206644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d837e918-5b85-4215-b408-06de41e19ef7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.206725] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d837e918-5b85-4215-b408-06de41e19ef7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.472658] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.560777] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.560961] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.561057] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.561272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.562574] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.562692] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.562845] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.562958] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.585520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.585860] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.586024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.586024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.586396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.586396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.586396] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 is going to be updated. [ 840.587434] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.587616] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.612423] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.613056] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.613056] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.613056] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.613056] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.614055] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.614055] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f is going to be updated. [ 840.614279] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.614496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.614582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.614762] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.614865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.614931] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.615092] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.615168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.615254] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be updated. [ 840.625429] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.625635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.625635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.625820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.625960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.645342] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 in Status: IN_PROGRESS for 2s [ 840.683531] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.684303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.684428] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.684623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.684768] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.686779] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.687190] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.687305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.687529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.687701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.704313] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f in Status: IN_PROGRESS for 2s [ 840.704313] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: IN_PROGRESS for 2s [ 840.708935] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.710453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.710713] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.711669] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d837e918-5b85-4215-b408-06de41e19ef7 with status ACTIVE [ 840.711853] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.712043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.712103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.712371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.712371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.712500] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.713431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.713431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.713431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.713431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.713431] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.713733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.714028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.714028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.714028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.714230] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d837e918-5b85-4215-b408-06de41e19ef7 is going to be updated. [ 840.742508] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.742976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.742976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.742976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.743135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.743252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d837e918-5b85-4215-b408-06de41e19ef7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.975033] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.217311] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.478835] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.479045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.479120] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.479431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.479563] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.479719] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac5de742-586a-4eea-8d29-9efb080dd556 is going to be updated. [ 841.508521] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.508521] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.508661] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.508762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.508915] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.518683] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: IN_PROGRESS for 2s [ 841.719833] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.720119] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.720119] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.720222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.720328] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.720429] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be created. [ 841.754771] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.754935] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.755028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.755211] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.755375] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.765564] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: UNINITIALIZED for 2s [ 841.827151] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 841.827678] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b deletion is rescheduled due to dependency. [ 841.827810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.894584] env[69343]: INFO networking_nsxv3.common.synchronization [None req-748d26f5-27cc-4a38-a912-536d1ef958c8 None None] Enqueued Resource ID: 5010d103-45b5-4cdd-bb47-b17c17cd9a1d with Priority: HIGHEST for action port [ 841.895128] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5010d103-45b5-4cdd-bb47-b17c17cd9a1d with Priority: HIGHEST for action port [ 841.895438] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-5010d103-45b5-4cdd-bb47-b17c17cd9a1d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.896460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5010d103-45b5-4cdd-bb47-b17c17cd9a1d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.896460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5010d103-45b5-4cdd-bb47-b17c17cd9a1d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.896460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5010d103-45b5-4cdd-bb47-b17c17cd9a1d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.896460] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5010d103-45b5-4cdd-bb47-b17c17cd9a1d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.401824] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5010d103-45b5-4cdd-bb47-b17c17cd9a1d [ 842.402225] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.402371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.402443] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.402715] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.402813] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.402917] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5010d103-45b5-4cdd-bb47-b17c17cd9a1d already deleted. [ 842.402999] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5010d103-45b5-4cdd-bb47-b17c17cd9a1d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.658144] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 in Status: SUCCESS [ 842.658442] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 deletion is rescheduled due to dependency. [ 842.658610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.719463] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b in Status: SUCCESS [ 842.719463] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b deletion is rescheduled due to dependency. [ 842.719463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.719463] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f in Status: SUCCESS [ 842.719463] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f deletion is rescheduled due to dependency. [ 842.719463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.532319] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: SUCCESS [ 843.532671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.777530] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 843.777530] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.777747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.777948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.781966] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.781966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.781966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.781966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.781966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.781966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.781966] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.282180] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.283028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.283028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.283028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.283028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.283028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.283028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.283412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.283412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.284797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.284797] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.284797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.284797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.284797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.285049] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.285049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.285166] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.285431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.285431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.285431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.285638] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.789988] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ff65ed7-3c36-4248-86bb-8bb20a53fde4: rpc.has_security_group_logging(os_id): False [ 844.807168] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.807560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.807673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.807968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.808125] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.808427] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.808561] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.808641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.808841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.808962] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.809171] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.809276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.809355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.809551] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.809644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.809855] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.810204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.810288] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.810517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.810632] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.810848] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be created. [ 844.878855] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.879194] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.879285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.879528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.879719] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.893266] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 846.897152] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 846.897152] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 846.911537] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 846.911791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.052900] env[69343]: INFO networking_nsxv3.common.synchronization [req-932f7218-7cbf-4e08-9737-e29745348623 req-914c4c3a-44e7-4e6d-8063-d0cd6c3806e3 tempest-ListImageFiltersTestJSON-216247362 tempest-ListImageFiltersTestJSON-216247362-project-member] Enqueued Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGHEST for action security_group_members [ 849.053522] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGHEST for action security_group_members [ 849.053837] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-992f0e18-2006-4c90-ae32-07de7a98af22 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.053964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.054107] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.054313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.054474] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.054572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.054634] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.054778] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.054864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.054963] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.562855] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.563116] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.563220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.563518] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.586650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.586650] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.586759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.586799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.587023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.587126] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.587551] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 992f0e18-2006-4c90-ae32-07de7a98af22 is going to be updated. [ 849.615974] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.615974] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.615974] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.615974] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.615974] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.626159] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 992f0e18-2006-4c90-ae32-07de7a98af22 in Status: IN_PROGRESS for 2s [ 851.637904] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 992f0e18-2006-4c90-ae32-07de7a98af22 in Status: SUCCESS [ 851.638376] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 992f0e18-2006-4c90-ae32-07de7a98af22 deletion is rescheduled due to dependency. [ 851.638376] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.714015] env[69343]: INFO networking_nsxv3.common.synchronization [req-c93eb2d9-5aaf-4abd-8a12-841214950dff req-aabc9d3d-291b-4dbd-a9a1-03498a793e58 tempest-ImagesTestJSON-628353040 tempest-ImagesTestJSON-628353040-project-member] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 852.714603] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 852.714914] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.715047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.715109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.715315] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.715479] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.715579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.715650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.715782] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.715865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.716011] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.201667] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-308 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.201667] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.201667] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.201667] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.201667] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.201667] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.201667] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.202017] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.202060] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.202275] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.202552] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.202552] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.202638] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.202710] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.202822] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.202998] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.218398] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.224596] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.224828] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 853.224922] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.226013] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.226013] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-54b4c61a-c475-4247-ba66-2587db2c12d0 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.226013] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-54b4c61a-c475-4247-ba66-2587db2c12d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.226013] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-54b4c61a-c475-4247-ba66-2587db2c12d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.226608] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-54b4c61a-c475-4247-ba66-2587db2c12d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.226608] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54b4c61a-c475-4247-ba66-2587db2c12d0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.722455] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.729083] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.729341] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.729483] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.729791] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.729969] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.730171] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 54b4c61a-c475-4247-ba66-2587db2c12d0 not found, creating... [ 853.730503] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.730692] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.731232] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.731508] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.731692] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.732043] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.732247] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.732397] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.732667] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.732845] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.733014] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 54b4c61a-c475-4247-ba66-2587db2c12d0 is going to be created. [ 853.756078] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.756078] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.756078] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.756078] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.756471] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.756471] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-54b4c61a-c475-4247-ba66-2587db2c12d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.226242] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.226242] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.226242] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.226386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.226482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.226540] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 854.258626] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.258626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.258626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.258819] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.262024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.268981] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 854.708194] env[69343]: INFO networking_nsxv3.common.synchronization [req-c93eb2d9-5aaf-4abd-8a12-841214950dff req-f6734ddb-3e74-4556-a8f3-457a9b356cbd service nova] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_rules [ 854.708194] env[69343]: INFO networking_nsxv3.common.synchronization [req-c93eb2d9-5aaf-4abd-8a12-841214950dff req-f6734ddb-3e74-4556-a8f3-457a9b356cbd service nova] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 854.708194] env[69343]: INFO networking_nsxv3.common.synchronization [req-c93eb2d9-5aaf-4abd-8a12-841214950dff req-f6734ddb-3e74-4556-a8f3-457a9b356cbd service nova] Enqueued Resource ID: 54b4c61a-c475-4247-ba66-2587db2c12d0 with Priority: HIGHEST for action port [ 854.708365] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_rules [ 854.708538] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 854.708614] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b4c61a-c475-4247-ba66-2587db2c12d0 with Priority: HIGHEST for action port [ 854.709259] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.709388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.709540] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.709674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.709730] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.710942] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.711093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.711309] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-54b4c61a-c475-4247-ba66-2587db2c12d0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.711440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54b4c61a-c475-4247-ba66-2587db2c12d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.711520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54b4c61a-c475-4247-ba66-2587db2c12d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.715029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54b4c61a-c475-4247-ba66-2587db2c12d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.715029] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54b4c61a-c475-4247-ba66-2587db2c12d0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.213799] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.213799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.218025] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54b4c61a-c475-4247-ba66-2587db2c12d0 with status ACTIVE [ 855.218025] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.218025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.218025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.218025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.218025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.218025] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.218025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.218025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.218025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.218025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.218025] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.218025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.218025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.218025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.218025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.218025] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54b4c61a-c475-4247-ba66-2587db2c12d0 is going to be updated. [ 855.248413] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.248707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.248707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.248866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.249689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.249976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54b4c61a-c475-4247-ba66-2587db2c12d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.344589] env[69343]: INFO networking_nsxv3.common.synchronization [req-30239a01-c7e1-49a4-9ced-951a16487d77 req-f917df11-dfbb-439b-95aa-0adddc12d2ff tempest-ServersAdminNegativeTestJSON-480893068 tempest-ServersAdminNegativeTestJSON-480893068-project-member] Enqueued Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGHEST for action security_group_members [ 855.345594] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGHEST for action security_group_members [ 855.346121] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.346322] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.346436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.346755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.347045] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.347231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.347356] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.347636] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.349084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.349084] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.681621] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.681904] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.681904] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.682219] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.682478] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.682657] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.683522] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.683522] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.683522] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.683522] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 855.683522] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 855.683793] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 855.683793] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 855.683793] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 855.683899] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 855.684024] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 855.705309] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 855.705667] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 855.705667] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 855.705801] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.706139] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-0bbe25ec-aec8-4c45-a983-436371e55fbf taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.706378] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-0bbe25ec-aec8-4c45-a983-436371e55fbf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.706588] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-0bbe25ec-aec8-4c45-a983-436371e55fbf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.706933] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-0bbe25ec-aec8-4c45-a983-436371e55fbf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.707087] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bbe25ec-aec8-4c45-a983-436371e55fbf',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.853426] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.210168] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.210402] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.210528] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.210803] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.210939] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.211187] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 0bbe25ec-aec8-4c45-a983-436371e55fbf not found, creating... [ 856.211488] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.211652] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.211767] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.212055] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.212234] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.212519] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.212674] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.212790] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.212998] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.213145] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.213284] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 0bbe25ec-aec8-4c45-a983-436371e55fbf is going to be created. [ 856.237448] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.237770] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.237913] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.238272] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.238568] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.238843] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-0bbe25ec-aec8-4c45-a983-436371e55fbf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.278371] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 856.278628] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.278797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.279023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.279217] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.279332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.279400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.279549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.279631] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.279725] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.354387] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.781663] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.857099] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.857099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.857099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.859720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.859720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.859720] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39709bac-2d5f-45f1-8871-b8dc216058be is going to be updated. [ 856.862984] env[69343]: INFO networking_nsxv3.common.synchronization [req-a7fff2cf-554f-40f2-b8a9-02c560405f5b req-9ef27dd8-b71b-4788-8db1-9e8eb5cb46af tempest-ServerActionsTestOtherA-678333832 tempest-ServerActionsTestOtherA-678333832-project-member] Enqueued Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGHEST for action security_group_members [ 856.864250] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGHEST for action security_group_members [ 856.865811] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b63028d-55ab-4a15-b3eb-44ca69536be6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.865984] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.866100] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.866362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.866725] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.866725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.866895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.867025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.867151] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.867273] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.895230] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.895230] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.895230] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.895230] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.895230] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.910023] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39709bac-2d5f-45f1-8871-b8dc216058be in Status: IN_PROGRESS for 2s [ 856.951694] env[69343]: INFO networking_nsxv3.common.synchronization [req-30239a01-c7e1-49a4-9ced-951a16487d77 req-84d108c9-6d9e-4b83-be09-011cf88f4c4e service nova] Enqueued Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGHEST for action security_group_rules [ 856.951694] env[69343]: INFO networking_nsxv3.common.synchronization [req-30239a01-c7e1-49a4-9ced-951a16487d77 req-84d108c9-6d9e-4b83-be09-011cf88f4c4e service nova] Enqueued Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGHEST for action security_group_members [ 856.951694] env[69343]: INFO networking_nsxv3.common.synchronization [req-30239a01-c7e1-49a4-9ced-951a16487d77 req-84d108c9-6d9e-4b83-be09-011cf88f4c4e service nova] Enqueued Resource ID: 0bbe25ec-aec8-4c45-a983-436371e55fbf with Priority: HIGHEST for action port [ 856.951694] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGHEST for action security_group_rules [ 856.951694] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGHEST for action security_group_members [ 856.951694] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bbe25ec-aec8-4c45-a983-436371e55fbf with Priority: HIGHEST for action port [ 856.951920] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.951920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.951920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.952148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.952230] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.953514] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.953611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.953918] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bbe25ec-aec8-4c45-a983-436371e55fbf taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.953918] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bbe25ec-aec8-4c45-a983-436371e55fbf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.954027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bbe25ec-aec8-4c45-a983-436371e55fbf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.954155] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bbe25ec-aec8-4c45-a983-436371e55fbf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.954231] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bbe25ec-aec8-4c45-a983-436371e55fbf',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.285338] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.372764] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.373200] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.373325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.373544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.373791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.373929] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.374015] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.374094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.374304] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.374615] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.374615] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 is going to be updated. [ 857.417120] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.417399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.417399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.417630] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.417782] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.427127] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 in Status: IN_PROGRESS for 2s [ 857.454717] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.454844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.458375] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0bbe25ec-aec8-4c45-a983-436371e55fbf with status ACTIVE [ 857.458635] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.459071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.459071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.459723] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.459723] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.459723] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.459723] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.459925] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.460038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.460084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.460253] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.460420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.460420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.460605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.460657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.460733] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0bbe25ec-aec8-4c45-a983-436371e55fbf is going to be updated. [ 857.482570] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.482702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.482745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.483034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.483179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.483345] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bbe25ec-aec8-4c45-a983-436371e55fbf" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.789237] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.789237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.789237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.789237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.789237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.789237] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 857.831477] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.831717] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.831806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.832076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.832240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.844756] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 857.965341] env[69343]: INFO networking_nsxv3.common.synchronization [req-cf138424-5500-4a86-88cc-9f784da16309 req-fe6330d7-d4c3-4960-8443-0f258eeb04c4 tempest-AttachVolumeNegativeTest-1961671669 tempest-AttachVolumeNegativeTest-1961671669-project-member] Enqueued Resource ID: dec2bd26-cf02-479f-bf2c-2ca399054600 with Priority: HIGHEST for action security_group_members [ 857.965941] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dec2bd26-cf02-479f-bf2c-2ca399054600 with Priority: HIGHEST for action security_group_members [ 857.966713] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-dec2bd26-cf02-479f-bf2c-2ca399054600 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.966846] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.966914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.967374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.967545] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.967654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.967720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.967888] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.967975] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.968084] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dec2bd26-cf02-479f-bf2c-2ca399054600',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.305035] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-837 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.305035] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-837" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.305035] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-837" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.305035] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-837" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.305035] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.305035] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.305035] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.305035] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.305035] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.305035] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 858.305035] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 858.305035] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 858.305035] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 858.306041] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 858.306041] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 858.306041] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 858.330169] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 858.330169] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 858.330169] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 858.330169] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-837" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.330169] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-dced06da-8301-4179-bcaa-bc907868c1f6 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.330169] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-dced06da-8301-4179-bcaa-bc907868c1f6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.330169] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-dced06da-8301-4179-bcaa-bc907868c1f6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.330169] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-dced06da-8301-4179-bcaa-bc907868c1f6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.330169] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dced06da-8301-4179-bcaa-bc907868c1f6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.475562] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.475562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.475562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.475562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.475562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.475562] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.475562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.475562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.475562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.475562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.475562] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dec2bd26-cf02-479f-bf2c-2ca399054600 already deleted. [ 858.475562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.833956] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.834308] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.834496] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.834914] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.835222] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.837267] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port dced06da-8301-4179-bcaa-bc907868c1f6 not found, creating... [ 858.837632] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.837801] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.837913] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.838228] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.838435] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.838927] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.839078] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.839215] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.839532] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.839692] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.839890] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: dced06da-8301-4179-bcaa-bc907868c1f6 is going to be created. [ 858.864100] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.865039] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.865039] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.865039] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.865039] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.865252] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-dced06da-8301-4179-bcaa-bc907868c1f6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.920479] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39709bac-2d5f-45f1-8871-b8dc216058be in Status: SUCCESS [ 858.920731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.920907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.921277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.921531] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.921659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.921730] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.921896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.921994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.922149] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.424619] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.440076] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 in Status: SUCCESS [ 859.440076] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 deletion is rescheduled due to dependency. [ 859.440076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.680228] env[69343]: INFO networking_nsxv3.common.synchronization [req-cf138424-5500-4a86-88cc-9f784da16309 req-b081b9d3-f364-477c-b483-e734a3425a38 service nova] Enqueued Resource ID: dec2bd26-cf02-479f-bf2c-2ca399054600 with Priority: HIGHEST for action security_group_rules [ 859.680228] env[69343]: INFO networking_nsxv3.common.synchronization [req-cf138424-5500-4a86-88cc-9f784da16309 req-b081b9d3-f364-477c-b483-e734a3425a38 service nova] Enqueued Resource ID: dec2bd26-cf02-479f-bf2c-2ca399054600 with Priority: HIGHEST for action security_group_members [ 859.680228] env[69343]: INFO networking_nsxv3.common.synchronization [req-cf138424-5500-4a86-88cc-9f784da16309 req-b081b9d3-f364-477c-b483-e734a3425a38 service nova] Enqueued Resource ID: dced06da-8301-4179-bcaa-bc907868c1f6 with Priority: HIGHEST for action port [ 859.680526] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dec2bd26-cf02-479f-bf2c-2ca399054600 with Priority: HIGHEST for action security_group_rules [ 859.680608] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dec2bd26-cf02-479f-bf2c-2ca399054600 with Priority: HIGHEST for action security_group_members [ 859.680710] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dced06da-8301-4179-bcaa-bc907868c1f6 with Priority: HIGHEST for action port [ 859.680988] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dec2bd26-cf02-479f-bf2c-2ca399054600 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.681820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.681897] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.682168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.682352] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dec2bd26-cf02-479f-bf2c-2ca399054600',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.683990] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-dec2bd26-cf02-479f-bf2c-2ca399054600 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.684144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.684263] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.684397] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.684557] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.684653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.684762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.685073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.688544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.688544] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dec2bd26-cf02-479f-bf2c-2ca399054600',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.688544] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-dced06da-8301-4179-bcaa-bc907868c1f6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.688544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dced06da-8301-4179-bcaa-bc907868c1f6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.688544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dced06da-8301-4179-bcaa-bc907868c1f6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.688544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dced06da-8301-4179-bcaa-bc907868c1f6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.688544] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dced06da-8301-4179-bcaa-bc907868c1f6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.872389] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 859.872389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.872389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.872389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.872389] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.872389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.872389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.872389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.872389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.872389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.872389] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.932261] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.078048] env[69343]: INFO networking_nsxv3.common.synchronization [req-d711bc2c-3596-4ee3-8223-92b7c515c90a req-812b76e6-cccb-4475-8f54-6c79ba2a1e4b tempest-MigrationsAdminTest-544745941 tempest-MigrationsAdminTest-544745941-project-member] Enqueued Resource ID: 1db02b01-820f-4081-802a-12188735ffe1 with Priority: HIGHEST for action security_group_members [ 860.078643] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db02b01-820f-4081-802a-12188735ffe1 with Priority: HIGHEST for action security_group_members [ 860.078945] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db02b01-820f-4081-802a-12188735ffe1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.079179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.079261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.079465] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.079793] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.079915] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.079981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.080151] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.080256] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.080350] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.185182] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-dec2bd26-cf02-479f-bf2c-2ca399054600 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.185182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.188306] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dec2bd26-cf02-479f-bf2c-2ca399054600',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.193017] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dced06da-8301-4179-bcaa-bc907868c1f6 with status ACTIVE [ 860.193017] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.193017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.193017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.193017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.193017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.193017] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.193017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.193017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.193017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.193017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.193017] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.193017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.193017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.193017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.193017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.193017] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dced06da-8301-4179-bcaa-bc907868c1f6 is going to be updated. [ 860.220685] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.220685] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.220685] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.220685] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.220685] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.220685] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dced06da-8301-4179-bcaa-bc907868c1f6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.375767] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.375889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.375980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.376336] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.376550] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.376662] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.376740] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.376990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.377163] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.377329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.377555] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.377665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.377732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.377887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.378054] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.378153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.378218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.378363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.378545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.378545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.378630] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.438508] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.438508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.438508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.438508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.439021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.439021] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39709bac-2d5f-45f1-8871-b8dc216058be is going to be updated. [ 860.477171] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.477171] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.477171] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.477394] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.477584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.489746] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39709bac-2d5f-45f1-8871-b8dc216058be in Status: IN_PROGRESS for 2s [ 860.583254] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.699689] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dec2bd26-cf02-479f-bf2c-2ca399054600',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.880806] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47b39a17-6794-4f6b-b042-45a1e062090b: rpc.has_security_group_logging(os_id): False [ 860.906672] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.906994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.907156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.907652] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.932232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.932232] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.932454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.932647] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.934671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.935039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.935361] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.935434] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.935586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.936128] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.936128] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.936328] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.936564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.936615] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.936890] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.937081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.937243] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 861.008729] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.009083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.009246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.009707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.009922] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.029986] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 861.085785] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.106464] env[69343]: INFO networking_nsxv3.common.synchronization [req-3c2de20b-45b2-46e2-81a4-ac72f81ec7dd req-bfab3a45-807f-47b1-a32b-fb9ef4c291a2 tempest-ServersWithSpecificFlavorTestJSON-666360316 tempest-ServersWithSpecificFlavorTestJSON-666360316-project-member] Enqueued Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_members [ 861.107082] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_members [ 861.107370] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3ee775-00c0-4c70-a79b-23338c04f67f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.107492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.107556] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.107759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.107923] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.108575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.108688] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.108886] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.108969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.109113] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.204607] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.204607] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.204607] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.204607] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.204607] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.204607] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dec2bd26-cf02-479f-bf2c-2ca399054600 is going to be created. [ 861.233467] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.233467] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.233655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.233844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.233948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.248310] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dec2bd26-cf02-479f-bf2c-2ca399054600 in Status: UNINITIALIZED for 2s [ 861.396956] env[69343]: INFO networking_nsxv3.common.synchronization [req-7dd255e0-ef07-4167-bea8-52e2db11715e req-0ab13521-362e-483b-8109-280dd2f1ab41 tempest-VolumesAssistedSnapshotsTest-291375593 tempest-VolumesAssistedSnapshotsTest-291375593-project-member] Enqueued Resource ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 with Priority: HIGHEST for action security_group_members [ 861.400251] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 with Priority: HIGHEST for action security_group_members [ 861.402705] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce998c5-dc06-41cd-af9e-8a9554ca2092 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.402870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.402986] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.403251] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.403444] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.403573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.403662] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.403870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.403960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.404133] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce998c5-dc06-41cd-af9e-8a9554ca2092',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.588570] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.588977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.588977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.590451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.590451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.590451] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db02b01-820f-4081-802a-12188735ffe1 is going to be updated. [ 861.612602] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.612811] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.612852] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.613088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.649170] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.651535] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.651746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.651826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.652273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.652493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.652536] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f is going to be updated. [ 861.659322] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.659502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.659585] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.659823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.660584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.682581] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db02b01-820f-4081-802a-12188735ffe1 in Status: IN_PROGRESS for 2s [ 861.706594] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.706821] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.706821] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.707077] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.707294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.725044] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f in Status: IN_PROGRESS for 2s [ 861.910919] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.910919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.910919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.910919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.935751] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.935811] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.935906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.936014] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.936223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.936310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.936415] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 is going to be updated. [ 861.969476] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.969476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.969476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.969476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.969476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.978403] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 in Status: IN_PROGRESS for 2s [ 862.501623] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39709bac-2d5f-45f1-8871-b8dc216058be in Status: SUCCESS [ 862.501838] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.502036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.502302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.502503] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.502682] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.502797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.502935] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.503024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.503117] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.503214] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.006016] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.006324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.006324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.006520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.006690] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.006807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.006873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.007047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.007142] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.007231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.007379] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.007472] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.007535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.007698] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.007836] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.007926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.007988] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.008168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.008248] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.008349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.008488] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.045765] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 863.046082] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.141681] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.141681] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.141681] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.141991] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.142042] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.260056] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dec2bd26-cf02-479f-bf2c-2ca399054600 in Status: SUCCESS [ 863.260250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.260405] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.260669] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.260892] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.261025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.261248] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.261524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.261670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.261822] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.261978] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dec2bd26-cf02-479f-bf2c-2ca399054600',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.511469] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39709bac-2d5f-45f1-8871-b8dc216058be: rpc.has_security_group_logging(os_id): False [ 863.529615] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.529793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.529834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.530067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.530159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.530376] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.530477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.530535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.530687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.530764] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.530937] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.531045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.531169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.531321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.531397] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.531586] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.531680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.531738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.531873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.531948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.532046] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39709bac-2d5f-45f1-8871-b8dc216058be is going to be updated. [ 863.593217] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.593428] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.593428] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.593658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.593807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.606018] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39709bac-2d5f-45f1-8871-b8dc216058be in Status: IN_PROGRESS for 2s [ 863.645484] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.697091] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db02b01-820f-4081-802a-12188735ffe1 in Status: SUCCESS [ 863.697344] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.735070] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f in Status: SUCCESS [ 863.735070] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f deletion is rescheduled due to dependency. [ 863.735070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.765949] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dec2bd26-cf02-479f-bf2c-2ca399054600',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.989375] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 in Status: SUCCESS [ 863.989522] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce998c5-dc06-41cd-af9e-8a9554ca2092 deletion is rescheduled due to dependency. [ 863.989604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce998c5-dc06-41cd-af9e-8a9554ca2092" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.147077] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.355598] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dec2bd26-cf02-479f-bf2c-2ca399054600: rpc.has_security_group_logging(os_id): False [ 864.384087] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.384272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.384347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.384563] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.384635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.384893] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.384991] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.385131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.385231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.385306] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.385396] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dec2bd26-cf02-479f-bf2c-2ca399054600 is going to be created. [ 864.464085] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.464223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.464381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.464505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.464705] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.478309] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dec2bd26-cf02-479f-bf2c-2ca399054600 in Status: IN_PROGRESS for 2s [ 864.654301] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 864.654301] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 864.792419] env[69343]: INFO networking_nsxv3.common.synchronization [req-7410c456-3964-4440-9ffa-c541758594a9 req-1db729f0-a115-4e6e-863d-864ef0e86bc8 tempest-ServersAdminTestJSON-624451732 tempest-ServersAdminTestJSON-624451732-project-member] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 864.793321] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 864.794154] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.794154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.794154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.794437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.794437] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.794591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.794591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.794721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.794841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.794978] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.297205] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.657202] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39709bac-2d5f-45f1-8871-b8dc216058be in Status: SUCCESS [ 865.657453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.692482] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.692714] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.692714] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.692912] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.707204] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 865.707685] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.709617] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 865.744279] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.744646] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.744869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.745211] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.752349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.753284] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 865.754033] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 865.754033] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 865.798573] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.798573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.798573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.798833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.799787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.800311] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 865.801129] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.878894] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.879205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.879347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.879643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.879955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.880385] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 865.946664] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.946898] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.946898] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.947086] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.947300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.947574] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:38. [ 865.947778] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'47b39a17-6794-4f6b-b042-45a1e062090b', '39709bac-2d5f-45f1-8871-b8dc216058be', '8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c', '7f3ee775-00c0-4c70-a79b-23338c04f67f', '44259464-12d7-4ca0-9bd3-7620c5aac9c5', '41baf9da-d5e0-42d8-b746-2d1f0ac61fb3', '4754c815-e215-49af-b64e-e52ebe2b915e', 'a8724753-bf27-4f9c-95b9-1ddfd48e01ee', '05ba88a3-ba5e-41f6-a0be-392b43ae9fcc', '8efad038-46d9-4629-9147-1741df5ffca3', 'a262f752-6979-47b1-b3be-fd7926447348', '55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2', '75c1cecf-8a26-40e7-a08b-f1a0818a4c6a', '40a389c1-84ea-4a8d-9f0b-0df3c555e73b', '992f0e18-2006-4c90-ae32-07de7a98af22', '0fd7d44f-0622-4667-b3c0-6139a73c5a07', '1cd1700e-14d5-46f1-b054-75d864a0fb1a', '6b63028d-55ab-4a15-b3eb-44ca69536be6', 'dec2bd26-cf02-479f-bf2c-2ca399054600', 'c52eea06-29db-49da-b0fb-ebb6ba4a8d86', '3973f86f-0821-4b7d-9e21-ccfe561c705b', '970edbb8-6a58-46c8-ad52-fe607c6c28e9', '4923a56f-6f82-4449-82ab-38fbf0c7542f', '2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b', 'b7614721-7a3e-40ba-83da-998503180bf3', '1d14af5b-7c75-428d-a5d6-e177dfd3d4e5', '7b7e2ff9-f297-4beb-8beb-6260aaac3c39', '7ceec863-0a7a-401b-a8e8-048823180971', '4ff65ed7-3c36-4248-86bb-8bb20a53fde4', 'c88723a0-b73a-488b-a081-450e868cf48a', '6ce998c5-dc06-41cd-af9e-8a9554ca2092', '67480949-2dd7-420c-b751-f7f48b752f53', 'a1f09c79-4735-45a5-8af5-ec47fcc9b65f', '1db02b01-820f-4081-802a-12188735ffe1', 'c490ab0a-5a62-4845-ab43-b72f0c00e5c1', '3d094c60-3a3c-417f-8a4b-5bc3132f56a7', 'ac5de742-586a-4eea-8d29-9efb080dd556', 'f65fedc2-bd86-4b46-8ea8-95f7086801cf'} {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 865.947778] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 865.972700] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.972700] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.972700] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.972700] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.972917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.972917] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 865.972986] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 865.973371] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 866.040439] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.040562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.040633] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.040896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.048587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.048587] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 866.048587] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 866.048587] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 866.048587] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 866.048587] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/38 resources of Type:Security Group Rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8efad038-46d9-4629-9147-1741df5ffca3 with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a262f752-6979-47b1-b3be-fd7926447348 with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dec2bd26-cf02-479f-bf2c-2ca399054600 with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGH for action security_group_rules [ 866.048587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.307584] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.307584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.307584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.307584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.307584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.307584] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be updated. [ 866.339095] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.339095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.339095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.339095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.339095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.355090] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: IN_PROGRESS for 2s [ 866.490116] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dec2bd26-cf02-479f-bf2c-2ca399054600 in Status: SUCCESS [ 866.490613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.512099] env[69343]: INFO networking_nsxv3.common.synchronization [req-81bf0a10-8486-4b77-a12b-ac5067246d32 req-29e549c3-ebb8-4e36-919c-884755af9549 tempest-ServerDiskConfigTestJSON-1018188129 tempest-ServerDiskConfigTestJSON-1018188129-project-member] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 866.512181] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 866.512454] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGH for action security_group_rules [ 866.512454] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c with Priority: HIGH for action security_group_rules [ 866.512585] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4754c815-e215-49af-b64e-e52ebe2b915e with Priority: HIGH for action security_group_rules [ 866.512639] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 992f0e18-2006-4c90-ae32-07de7a98af22 with Priority: HIGH for action security_group_rules [ 866.512694] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 with Priority: HIGH for action security_group_rules [ 866.513598] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dec2bd26-cf02-479f-bf2c-2ca399054600 with Priority: HIGH for action security_group_rules [ 866.513598] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGH for action security_group_rules [ 866.513598] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a with Priority: HIGH for action security_group_rules [ 866.513598] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b with Priority: HIGH for action security_group_rules [ 866.513598] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 with Priority: HIGH for action security_group_rules [ 866.513906] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGH for action security_group_rules [ 866.513906] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 with Priority: HIGH for action security_group_rules [ 866.514013] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a262f752-6979-47b1-b3be-fd7926447348 with Priority: HIGH for action security_group_rules [ 866.514066] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8efad038-46d9-4629-9147-1741df5ffca3 with Priority: HIGH for action security_group_rules [ 866.514157] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGH for action security_group_rules [ 866.514248] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 with Priority: HIGH for action security_group_rules [ 866.514335] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee with Priority: HIGH for action security_group_rules [ 866.514425] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 with Priority: HIGH for action security_group_rules [ 866.514531] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGH for action security_group_rules [ 866.514585] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGH for action security_group_rules [ 866.514877] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.515008] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.515078] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.515264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.515420] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.516412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.516484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.516718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.516787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.516863] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.520425] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.520582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.520669] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.520833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.520833] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.521796] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.521932] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.521992] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.522316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.522316] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.523627] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4754c815-e215-49af-b64e-e52ebe2b915e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.523627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.523627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.523627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.523627] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4754c815-e215-49af-b64e-e52ebe2b915e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.524591] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-992f0e18-2006-4c90-ae32-07de7a98af22 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.524591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.524591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.524591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.524856] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('992f0e18-2006-4c90-ae32-07de7a98af22',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.529877] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.529877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.529877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.529877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.529877] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c52eea06-29db-49da-b0fb-ebb6ba4a8d86',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.529877] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dec2bd26-cf02-479f-bf2c-2ca399054600 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.529877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.529877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.529877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.529877] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dec2bd26-cf02-479f-bf2c-2ca399054600',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.529877] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b63028d-55ab-4a15-b3eb-44ca69536be6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.529877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.529877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.529877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.529877] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.529877] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cd1700e-14d5-46f1-b054-75d864a0fb1a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.529877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.529877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.530608] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.530608] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cd1700e-14d5-46f1-b054-75d864a0fb1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.535333] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.535468] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.535528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.535707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.535784] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40a389c1-84ea-4a8d-9f0b-0df3c555e73b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.536180] env[69343]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 866.536863] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.536972] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.537122] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.537596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.537596] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fd7d44f-0622-4667-b3c0-6139a73c5a07',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.538764] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.538862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.539786] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.539786] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.539786] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.540215] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.540287] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.540323] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.542045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.542045] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.542045] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a262f752-6979-47b1-b3be-fd7926447348 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.542045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.542045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.542045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.542045] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a262f752-6979-47b1-b3be-fd7926447348',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.543385] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8efad038-46d9-4629-9147-1741df5ffca3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.543487] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.543997] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.543997] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.543997] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8efad038-46d9-4629-9147-1741df5ffca3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.544979] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.545099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.545150] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.545626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.545626] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.546458] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.546567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.547247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.547247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.547247] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41baf9da-d5e0-42d8-b746-2d1f0ac61fb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.547638] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8724753-bf27-4f9c-95b9-1ddfd48e01ee taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.547741] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.547906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.547963] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.548052] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8724753-bf27-4f9c-95b9-1ddfd48e01ee',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.549062] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.549062] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.549243] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.549365] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.549365] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44259464-12d7-4ca0-9bd3-7620c5aac9c5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.551758] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.551758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.551758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.551758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.551758] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.551758] env[69343]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 866.552170] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f3ee775-00c0-4c70-a79b-23338c04f67f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.555354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.555354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.555354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.555354] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.916067] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.916067] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.916067] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.916697] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.917468] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.917468] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.917468] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.917780] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.917963] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.918227] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.918371] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.918491] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.918604] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.918719] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.918831] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.919009] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.940043] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.940270] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 866.940657] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.940657] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.940960] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-2969b78b-060c-4eef-8a37-72a6ce7c5389 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.941225] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-2969b78b-060c-4eef-8a37-72a6ce7c5389" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.941531] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-2969b78b-060c-4eef-8a37-72a6ce7c5389" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.941697] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-2969b78b-060c-4eef-8a37-72a6ce7c5389" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.941838] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2969b78b-060c-4eef-8a37-72a6ce7c5389',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.054622] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.054787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.054860] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.055067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.055497] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.055567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.055605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.055760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.056781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.056781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.056781] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.057351] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.057351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.057351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.057351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.078786] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.078927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.079833] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.079947] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.080912] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.084356] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.085296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.085519] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.085628] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.085695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.085929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.086051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.086162] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 867.088606] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.088721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.088790] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.088964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.089124] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.089220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.089288] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.089456] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.089559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.089661] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.089766] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.091695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.091864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.111250] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.111589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.113643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.113643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.113643] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.113643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.113643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.113643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.113643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.113643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.113643] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.115486] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-dec2bd26-cf02-479f-bf2c-2ca399054600 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.115603] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.115680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.116012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.116184] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.116281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.116341] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.116549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.116655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.116743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.116861] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dec2bd26-cf02-479f-bf2c-2ca399054600',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.160978] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.161155] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.162947] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.163072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.167739] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.167856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.168788] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.168911] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c is going to be deleted. [ 867.170268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.170383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.172641] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.172802] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.175172] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.175172] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.175446] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.175510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.176214] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.176343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.176410] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.176630] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.176771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.178593] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.179480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.181342] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.181342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.181728] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.182467] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.183148] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.183248] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.183968] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.184071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.187079] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 867.187513] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.187612] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.190608] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 867.190608] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.190775] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.194207] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 867.194591] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 867.204438] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 867.204956] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.205147] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4754c815-e215-49af-b64e-e52ebe2b915e is going to be deleted. [ 867.206194] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.206425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.229075] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.229729] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a262f752-6979-47b1-b3be-fd7926447348 is going to be deleted. [ 867.230734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.231555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.244794] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.244990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.260235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.260401] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fd7d44f-0622-4667-b3c0-6139a73c5a07 is going to be deleted. [ 867.261484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.261717] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.264879] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.265031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.287094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.287239] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 is going to be deleted. [ 867.288233] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.288447] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.302152] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.302152] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.310114] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.310114] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40a389c1-84ea-4a8d-9f0b-0df3c555e73b is going to be deleted. [ 867.310902] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.311253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.353990] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.354133] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.354959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.355095] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41baf9da-d5e0-42d8-b746-2d1f0ac61fb3 is going to be deleted. [ 867.356534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.356534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.417458] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.417458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.422106] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.422548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.436783] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.436783] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c52eea06-29db-49da-b0fb-ebb6ba4a8d86 is going to be deleted. [ 867.437019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.437234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.447022] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.447022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.447022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.447022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.447022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.447022] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 2969b78b-060c-4eef-8a37-72a6ce7c5389 not found, creating... [ 867.447022] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.447022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.447022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.447022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.447022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.447539] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.447539] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.447539] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.447539] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.447730] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.448014] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 2969b78b-060c-4eef-8a37-72a6ce7c5389 is going to be created. [ 867.463869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.464913] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2 is going to be deleted. [ 867.467110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.467110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.472296] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.472296] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.472296] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.473356] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.474019] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.475605] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-2969b78b-060c-4eef-8a37-72a6ce7c5389" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.521076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.521076] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cd1700e-14d5-46f1-b054-75d864a0fb1a is going to be deleted. [ 867.522786] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.522786] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.524468] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.524612] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.557782] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.558069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.561661] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.561973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.561973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.562165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.562391] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.562527] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.562611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.562795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.562910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.563015] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.563654] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.563654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.563654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.564369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.564369] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.564369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.564369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.564369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.564369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.564369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.564598] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.585117] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.585248] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44259464-12d7-4ca0-9bd3-7620c5aac9c5 is going to be deleted. [ 867.586486] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.586734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.598876] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.599040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.599146] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.599324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.599487] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.599579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.599634] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.600024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.600024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.600024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.600344] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.600344] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.600344] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.601729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.601729] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.601729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.601729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.601729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.601729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.601729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.601729] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.620110] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dec2bd26-cf02-479f-bf2c-2ca399054600',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.622132] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.650810] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.651054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.662477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.662477] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8724753-bf27-4f9c-95b9-1ddfd48e01ee is going to be deleted. [ 867.662624] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.663267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.665800] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.665922] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.733753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.734584] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f is going to be deleted. [ 867.737707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.737862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.775823] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.775823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.815200] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.815200] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 992f0e18-2006-4c90-ae32-07de7a98af22 is going to be deleted. [ 867.816589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.816589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.838392] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.838392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.865705] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.865965] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8efad038-46d9-4629-9147-1741df5ffca3 is going to be deleted. [ 867.867476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.870297] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.870490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.870685] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ac8a1a1-8c75-47a3-9d6a-0f765d967b8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.870876] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.871398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.871398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.871398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4754c815-e215-49af-b64e-e52ebe2b915e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.873271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.873271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.873271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.873271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a262f752-6979-47b1-b3be-fd7926447348" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.873271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.873271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.873271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.873877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fd7d44f-0622-4667-b3c0-6139a73c5a07" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.874078] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.874455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.874577] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.874755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40a389c1-84ea-4a8d-9f0b-0df3c555e73b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.874970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.875199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.875370] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.875497] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.875633] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.875785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.875878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.875987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41baf9da-d5e0-42d8-b746-2d1f0ac61fb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.876133] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.876281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.876357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.876469] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c52eea06-29db-49da-b0fb-ebb6ba4a8d86" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.876616] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.876771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.876849] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.876965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55a24a84-3b35-4b7b-a4fc-eba9dd14b0d2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.877185] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.877430] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.877578] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.877643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cd1700e-14d5-46f1-b054-75d864a0fb1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.877800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.877982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.878038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.878153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44259464-12d7-4ca0-9bd3-7620c5aac9c5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.878278] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.878419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.878494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.878599] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8724753-bf27-4f9c-95b9-1ddfd48e01ee" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.918677] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.918677] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.918677] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.918912] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.918912] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.918912] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.994080] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.994230] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.994292] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.994518] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.994607] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.994733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-992f0e18-2006-4c90-ae32-07de7a98af22" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.998857] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 867.999641] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.999917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.999984] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.000212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.000304] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.000423] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8efad038-46d9-4629-9147-1741df5ffca3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.068058] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47b39a17-6794-4f6b-b042-45a1e062090b: rpc.has_security_group_logging(os_id): False [ 868.103879] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39709bac-2d5f-45f1-8871-b8dc216058be: rpc.has_security_group_logging(os_id): False [ 868.107483] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.107483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.107483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.107671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.124099] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dec2bd26-cf02-479f-bf2c-2ca399054600: rpc.has_security_group_logging(os_id): False [ 868.125692] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc: rpc.has_security_group_logging(os_id): False [ 868.151580] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.151580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.151580] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.151580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.163034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.163034] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.163034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.163034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.163034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.163034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.163034] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.163034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.163034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.163034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.163034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.163034] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.163034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.163034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.163870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.163870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.165710] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 868.166413] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.166638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.168675] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.169316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.206663] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.207120] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.207314] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.207408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.207686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.207764] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.207984] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.208147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.208238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.208425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.208530] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.208871] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.208871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.209033] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.209114] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.209215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.209335] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39709bac-2d5f-45f1-8871-b8dc216058be is going to be updated. [ 868.210447] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.210664] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.240422] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.240729] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.240900] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.240947] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.241224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.241275] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.241333] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dec2bd26-cf02-479f-bf2c-2ca399054600 is going to be updated. [ 868.242430] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.242620] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.273959] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.273959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.285883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.288156] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.288156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.288156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.288156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.288156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.288156] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc is going to be updated. [ 868.288882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.289194] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.289368] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.322167] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 868.358465] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.358611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.358681] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.358938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.359066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.370022] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: SUCCESS [ 868.370311] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.370503] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.370727] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.370944] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.371138] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.371208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.371400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.371532] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.371634] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.371733] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.378279] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39709bac-2d5f-45f1-8871-b8dc216058be in Status: IN_PROGRESS for 2s [ 868.383717] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.387019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.387019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.387019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.387019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.410288] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.410468] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.410598] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.410768] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.411029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.420102] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dec2bd26-cf02-479f-bf2c-2ca399054600 in Status: IN_PROGRESS for 2s [ 868.466711] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: IN_PROGRESS for 2s [ 868.494506] env[69343]: INFO networking_nsxv3.common.synchronization [req-81bf0a10-8486-4b77-a12b-ac5067246d32 req-c6354fb7-ef95-4b95-b443-5c1eecd48a91 service nova] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_rules [ 868.500374] env[69343]: INFO networking_nsxv3.common.synchronization [req-81bf0a10-8486-4b77-a12b-ac5067246d32 req-c6354fb7-ef95-4b95-b443-5c1eecd48a91 service nova] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 868.500374] env[69343]: INFO networking_nsxv3.common.synchronization [req-81bf0a10-8486-4b77-a12b-ac5067246d32 req-c6354fb7-ef95-4b95-b443-5c1eecd48a91 service nova] Enqueued Resource ID: 2969b78b-060c-4eef-8a37-72a6ce7c5389 with Priority: HIGHEST for action port [ 868.500374] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_rules [ 868.500374] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 868.500374] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2969b78b-060c-4eef-8a37-72a6ce7c5389 with Priority: HIGHEST for action port [ 868.500374] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.500374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.500374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.500826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.500826] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.502411] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.502411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.502632] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-2969b78b-060c-4eef-8a37-72a6ce7c5389 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.502709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2969b78b-060c-4eef-8a37-72a6ce7c5389" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.502755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2969b78b-060c-4eef-8a37-72a6ce7c5389" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.502986] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2969b78b-060c-4eef-8a37-72a6ce7c5389" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.503089] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2969b78b-060c-4eef-8a37-72a6ce7c5389',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.882577] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.882794] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.882794] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.883018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.883200] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.883308] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.883372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.883536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.883621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.883707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.883853] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.883945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.884013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.884164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.884302] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.884392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.884451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.884583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.884658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.884738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.884832] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.005310] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.005452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.006833] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2969b78b-060c-4eef-8a37-72a6ce7c5389 with status ACTIVE [ 869.007042] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.007208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.007280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.007493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.007584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.007765] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.007862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.007923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.008113] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.008194] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.008377] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.008500] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.008536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.008682] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.008754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.008851] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2969b78b-060c-4eef-8a37-72a6ce7c5389 is going to be updated. [ 869.036037] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.036248] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.036294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.036511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.036789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.036869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2969b78b-060c-4eef-8a37-72a6ce7c5389" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.209637] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 869.209637] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b deletion is rescheduled due to dependency. [ 869.209637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.209637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.209637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.209637] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.209637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.209637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.209637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.209637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.209637] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.388185] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a: rpc.has_security_group_logging(os_id): False [ 869.404486] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.404644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.404691] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.405454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.428811] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.430413] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.434395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.434395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.434395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.434395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.434395] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.434395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.434395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.434395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.434395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.434395] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.434395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.434395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.434395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.434395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.434395] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be updated. [ 869.480837] env[69343]: INFO networking_nsxv3.common.synchronization [None req-21c15ceb-3b33-4150-aad2-32a8bd30a16f None None] Enqueued Resource ID: 617a4466-1162-4c5f-9c3e-6edc27ee9202 with Priority: HIGHEST for action port [ 869.480837] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 617a4466-1162-4c5f-9c3e-6edc27ee9202 with Priority: HIGHEST for action port [ 869.480837] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-617a4466-1162-4c5f-9c3e-6edc27ee9202 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.480837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-617a4466-1162-4c5f-9c3e-6edc27ee9202" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.480837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-617a4466-1162-4c5f-9c3e-6edc27ee9202" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.480837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-617a4466-1162-4c5f-9c3e-6edc27ee9202" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.480837] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('617a4466-1162-4c5f-9c3e-6edc27ee9202',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.517787] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.517787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.517787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.518046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.518102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.535609] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: IN_PROGRESS for 2s [ 869.714714] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.986918] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 617a4466-1162-4c5f-9c3e-6edc27ee9202 [ 869.986918] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.986918] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.988579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.988579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.988579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.988579] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:617a4466-1162-4c5f-9c3e-6edc27ee9202 already deleted. [ 869.988579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-617a4466-1162-4c5f-9c3e-6edc27ee9202" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.217368] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.340169] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 870.340481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.395204] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39709bac-2d5f-45f1-8871-b8dc216058be in Status: SUCCESS [ 870.395599] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.439082] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dec2bd26-cf02-479f-bf2c-2ca399054600 in Status: SUCCESS [ 870.439082] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.486320] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: SUCCESS [ 870.486320] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.723631] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.723804] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.723881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.724144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.724241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.724359] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 870.757301] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.757503] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.757581] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.757809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.757938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.768614] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 871.560469] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: SUCCESS [ 871.561463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.039387] env[69343]: INFO networking_nsxv3.common.synchronization [None req-993d4a56-6d19-4262-8eb8-055dc3f5578a None None] Enqueued Resource ID: 8a9989ce-22c1-4f59-92dc-2a7414a1546b with Priority: HIGHEST for action port [ 872.039387] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a9989ce-22c1-4f59-92dc-2a7414a1546b with Priority: HIGHEST for action port [ 872.039819] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a9989ce-22c1-4f59-92dc-2a7414a1546b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.039940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a9989ce-22c1-4f59-92dc-2a7414a1546b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.040013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a9989ce-22c1-4f59-92dc-2a7414a1546b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.040317] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a9989ce-22c1-4f59-92dc-2a7414a1546b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.040358] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a9989ce-22c1-4f59-92dc-2a7414a1546b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.386041] env[69343]: INFO networking_nsxv3.common.synchronization [req-8b21a3d2-e614-4d5f-92dd-b14f0dfb5f44 req-c2bf9792-6bfe-4e17-87e0-384aee5adc57 tempest-ImagesTestJSON-628353040 tempest-ImagesTestJSON-628353040-project-member] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 872.386538] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 872.386851] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.386982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.387086] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.387277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.387433] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.387531] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.387595] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.387736] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.387820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.387917] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.543189] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a9989ce-22c1-4f59-92dc-2a7414a1546b [ 872.543486] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.543652] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.543731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.543985] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.545508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.545711] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a9989ce-22c1-4f59-92dc-2a7414a1546b already deleted. [ 872.546245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a9989ce-22c1-4f59-92dc-2a7414a1546b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.578760] env[69343]: INFO networking_nsxv3.common.synchronization [req-2e82c047-d960-45da-9978-cc84295b56d7 req-9a205bcf-203a-4b26-b72c-fd6483b4ebcd tempest-ServersAdminNegativeTestJSON-480893068 tempest-ServersAdminNegativeTestJSON-480893068-project-member] Enqueued Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGHEST for action security_group_members [ 872.579437] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGHEST for action security_group_members [ 872.579772] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.579921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.579992] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.580213] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.580600] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.580600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.580600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.581035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.581035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.581035] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.779828] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 872.779828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.779995] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.780292] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.780527] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.780688] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.780745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.781325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.781325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.781325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.781325] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.891265] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.084484] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.285978] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.286150] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.286223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.286454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.286639] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.286722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.286842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.286926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.287025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.287111] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.287296] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.287358] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.287412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.287558] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.287691] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.287777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.287834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.287969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.288178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.288178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.288264] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.393480] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.588781] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.736178] env[69343]: INFO networking_nsxv3.common.synchronization [req-b445a5c1-4983-4ce2-89ea-c97d23a0609a req-278cae7c-8b57-49b2-96ef-4b508907f23c tempest-ListServerFiltersTestJSON-1584999217 tempest-ListServerFiltersTestJSON-1584999217-project-member] Enqueued Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 873.736772] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 873.737143] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.737271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.737377] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.737601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.737698] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.737826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.737884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.738027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.738084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.738181] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.792040] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3973f86f-0821-4b7d-9e21-ccfe561c705b: rpc.has_security_group_logging(os_id): False [ 873.810626] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.810800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.810848] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.811093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.811161] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.811360] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.811487] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.811563] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.811721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.811812] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.812113] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.812189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.812223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.812355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.812429] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.812605] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.812697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.812755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.812892] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.812961] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.814044] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 873.883748] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.883905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.883954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.884176] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.884326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.897455] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.897455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.897455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.897455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.897455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.897455] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 873.902599] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 873.939113] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.941023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.941023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.941023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.941023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.976430] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 874.094502] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.094674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.094754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.094972] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.095091] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.095205] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39709bac-2d5f-45f1-8871-b8dc216058be is going to be updated. [ 874.163041] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.163201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.163269] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.163497] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.163654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.187516] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39709bac-2d5f-45f1-8871-b8dc216058be in Status: IN_PROGRESS for 2s [ 874.240027] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.743601] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.245054] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.245250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.245351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.245501] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.245589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.245702] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac5de742-586a-4eea-8d29-9efb080dd556 is going to be updated. [ 875.275795] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.275997] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.276050] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.276279] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.276444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.286424] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: IN_PROGRESS for 2s [ 875.807710] env[69343]: INFO networking_nsxv3.common.synchronization [req-316cb0ef-1874-4c9f-ae21-43ae42f84fe5 req-a06be9d4-d710-418f-be7d-e1c5aac2bdf6 tempest-ServerAddressesTestJSON-690527140 tempest-ServerAddressesTestJSON-690527140-project-member] Enqueued Resource ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 with Priority: HIGHEST for action security_group_members [ 875.808378] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 with Priority: HIGHEST for action security_group_members [ 875.808747] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba723a9-f8bb-4746-b83f-2c283502bde3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.808875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.808943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.809325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.809479] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.809582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.809645] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.809796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.809881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.809977] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba723a9-f8bb-4746-b83f-2c283502bde3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.918522] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 875.918782] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.988240] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 875.988240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.199444] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39709bac-2d5f-45f1-8871-b8dc216058be in Status: SUCCESS [ 876.199444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.275330] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-203 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.275330] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-203" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.275330] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-203" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.279029] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-203" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.279029] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.279029] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.279029] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.279029] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.279029] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.279029] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 876.279029] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.279029] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.279029] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.280300] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 876.280658] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.281077] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.312063] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.312583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.312785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.313119] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.313338] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.313667] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.313914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.314111] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.314693] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.314693] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.314693] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 already deleted. [ 876.314693] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.322446] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.322446] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 876.322446] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.322446] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-203" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.322446] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-490619be-f71b-48a8-822f-2428c8f37465 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.322446] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-490619be-f71b-48a8-822f-2428c8f37465" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.322446] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-490619be-f71b-48a8-822f-2428c8f37465" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.322446] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-490619be-f71b-48a8-822f-2428c8f37465" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.322446] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('490619be-f71b-48a8-822f-2428c8f37465',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.828083] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.828083] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.828083] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.828083] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.828083] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.828083] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 490619be-f71b-48a8-822f-2428c8f37465 not found, creating... [ 876.828083] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.828083] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.828083] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.828083] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.828083] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.828861] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.828861] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.828861] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.830113] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.830967] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.831281] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 490619be-f71b-48a8-822f-2428c8f37465 is going to be created. [ 876.861080] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.861080] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.861080] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.861080] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.861080] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.861080] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-490619be-f71b-48a8-822f-2428c8f37465" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.301613] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: SUCCESS [ 877.304269] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.885698] env[69343]: INFO networking_nsxv3.common.synchronization [None req-a8687e83-af9f-45f6-8285-ab36ab0e0e17 None None] Enqueued Resource ID: 4a8f8e7d-356a-40be-871f-acfe321142db with Priority: HIGHEST for action port [ 877.886127] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a8f8e7d-356a-40be-871f-acfe321142db with Priority: HIGHEST for action port [ 877.886447] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a8f8e7d-356a-40be-871f-acfe321142db taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.886725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a8f8e7d-356a-40be-871f-acfe321142db" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.886725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a8f8e7d-356a-40be-871f-acfe321142db" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.887374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a8f8e7d-356a-40be-871f-acfe321142db" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.887374] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a8f8e7d-356a-40be-871f-acfe321142db',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.929400] env[69343]: INFO networking_nsxv3.common.synchronization [req-65cd32f5-6d16-4992-aaf0-9738fd0f677d req-ed5e79cb-79b6-4ee3-85cd-358175b828e0 tempest-VolumesAdminNegativeTest-1863638197 tempest-VolumesAdminNegativeTest-1863638197-project-member] Enqueued Resource ID: 67480949-2dd7-420c-b751-f7f48b752f53 with Priority: HIGHEST for action security_group_members [ 877.930028] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67480949-2dd7-420c-b751-f7f48b752f53 with Priority: HIGHEST for action security_group_members [ 877.930403] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-67480949-2dd7-420c-b751-f7f48b752f53 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.930600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.930712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.933351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.934571] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.934571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.934571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.934571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.934571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.934794] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67480949-2dd7-420c-b751-f7f48b752f53',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.993625] env[69343]: INFO networking_nsxv3.common.synchronization [req-316cb0ef-1874-4c9f-ae21-43ae42f84fe5 req-8ef1abf2-2c75-4574-8d5a-699abeb5305b service nova] Enqueued Resource ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 with Priority: HIGHEST for action security_group_rules [ 877.993880] env[69343]: INFO networking_nsxv3.common.synchronization [req-316cb0ef-1874-4c9f-ae21-43ae42f84fe5 req-8ef1abf2-2c75-4574-8d5a-699abeb5305b service nova] Enqueued Resource ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 with Priority: HIGHEST for action security_group_members [ 877.994181] env[69343]: INFO networking_nsxv3.common.synchronization [req-316cb0ef-1874-4c9f-ae21-43ae42f84fe5 req-8ef1abf2-2c75-4574-8d5a-699abeb5305b service nova] Enqueued Resource ID: 490619be-f71b-48a8-822f-2428c8f37465 with Priority: HIGHEST for action port [ 877.994741] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 with Priority: HIGHEST for action security_group_rules [ 877.995134] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 with Priority: HIGHEST for action security_group_members [ 877.995576] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490619be-f71b-48a8-822f-2428c8f37465 with Priority: HIGHEST for action port [ 877.995767] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ba723a9-f8bb-4746-b83f-2c283502bde3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.995906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.995977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.996318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.996408] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ba723a9-f8bb-4746-b83f-2c283502bde3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.997347] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba723a9-f8bb-4746-b83f-2c283502bde3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.997447] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.997489] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.997651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.997795] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.997880] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.997945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.998089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.998165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.998257] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba723a9-f8bb-4746-b83f-2c283502bde3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.999940] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-490619be-f71b-48a8-822f-2428c8f37465 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.000068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-490619be-f71b-48a8-822f-2428c8f37465" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.000137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-490619be-f71b-48a8-822f-2428c8f37465" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.000296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-490619be-f71b-48a8-822f-2428c8f37465" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.000370] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('490619be-f71b-48a8-822f-2428c8f37465',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.392419] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a8f8e7d-356a-40be-871f-acfe321142db [ 878.392419] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.392419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.392419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.392419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.392419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.392419] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a8f8e7d-356a-40be-871f-acfe321142db already deleted. [ 878.392419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a8f8e7d-356a-40be-871f-acfe321142db" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.442884] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.442884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.442884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.442884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.462586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.463579] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.463579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.463579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.463579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.463579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.463579] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67480949-2dd7-420c-b751-f7f48b752f53 is going to be updated. [ 878.495514] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.495690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.495747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.496045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.496228] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.501991] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba723a9-f8bb-4746-b83f-2c283502bde3 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.502151] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.502363] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ba723a9-f8bb-4746-b83f-2c283502bde3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.503938] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 490619be-f71b-48a8-822f-2428c8f37465 with status ACTIVE [ 878.503938] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.503938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.503938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.504282] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.504282] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.504366] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.504428] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.504499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.504709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.504789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.504995] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.505215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.505269] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.505436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.505522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.505607] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 490619be-f71b-48a8-822f-2428c8f37465 is going to be updated. [ 878.507344] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67480949-2dd7-420c-b751-f7f48b752f53 in Status: IN_PROGRESS for 2s [ 878.527527] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.527683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.527733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.527979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.528088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.528284] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-490619be-f71b-48a8-822f-2428c8f37465" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.008972] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ba723a9-f8bb-4746-b83f-2c283502bde3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.513488] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.513488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.513488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.513488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.513488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.513488] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 is going to be created. [ 879.537980] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.538436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.538677] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.539047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.539409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.551680] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 in Status: UNINITIALIZED for 2s [ 879.820811] env[69343]: INFO networking_nsxv3.common.synchronization [None req-fd21eab9-f9ac-4ecf-bd5a-03b67fef9555 None None] Enqueued Resource ID: 26728589-c35d-41f2-bc77-950e216a3ddd with Priority: HIGHEST for action port [ 879.820993] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26728589-c35d-41f2-bc77-950e216a3ddd with Priority: HIGHEST for action port [ 879.821751] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-26728589-c35d-41f2-bc77-950e216a3ddd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.821916] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26728589-c35d-41f2-bc77-950e216a3ddd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.821985] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26728589-c35d-41f2-bc77-950e216a3ddd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.822267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26728589-c35d-41f2-bc77-950e216a3ddd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.822377] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26728589-c35d-41f2-bc77-950e216a3ddd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.328642] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26728589-c35d-41f2-bc77-950e216a3ddd [ 880.328933] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.329081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.329299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.329497] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.329579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.330885] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26728589-c35d-41f2-bc77-950e216a3ddd already deleted. [ 880.330885] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26728589-c35d-41f2-bc77-950e216a3ddd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.517913] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67480949-2dd7-420c-b751-f7f48b752f53 in Status: SUCCESS [ 880.517913] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67480949-2dd7-420c-b751-f7f48b752f53 deletion is rescheduled due to dependency. [ 880.517913] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67480949-2dd7-420c-b751-f7f48b752f53" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.563901] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 in Status: SUCCESS [ 881.563901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.563901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.563901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.563901] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.564484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.564484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.564484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.564484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.564484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.564484] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ba723a9-f8bb-4746-b83f-2c283502bde3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.066671] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba723a9-f8bb-4746-b83f-2c283502bde3 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.066820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.066891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.067132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.067298] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.067399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.067464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.067618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.067873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.067990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.068173] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba723a9-f8bb-4746-b83f-2c283502bde3 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.068279] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.068347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.068503] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.068645] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.068740] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.068803] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.068943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.069035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.069127] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.069291] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ba723a9-f8bb-4746-b83f-2c283502bde3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.571071] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ba723a9-f8bb-4746-b83f-2c283502bde3: rpc.has_security_group_logging(os_id): False [ 882.591970] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.591970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.591970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.591970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.591970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.591970] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.592748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.592748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.592748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.592748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.592748] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.592748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.592748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.593164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.593164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.593164] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.593368] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.593368] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.593603] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.593603] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.593603] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 is going to be created. [ 882.672988] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.673154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.673206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.673431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.673641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.687632] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 in Status: IN_PROGRESS for 2s [ 884.702846] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 in Status: SUCCESS [ 884.702846] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.822486] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 884.822598] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 889.826482] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 889.826482] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 889.826482] env[69343]: INFO networking_nsxv3.common.synchronization [req-c28fc221-f89d-4380-bf72-48e4fc93c9fe req-f7bfc563-4a65-47e8-80e6-f0da628e3bda tempest-ServersTestJSON-245111932 tempest-ServersTestJSON-245111932-project-member] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 889.826482] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 889.831978] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.831978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.831978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.831978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.831978] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.831978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.831978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.831978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.831978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.831978] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.200400] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.200654] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.200775] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.201017] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.201308] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.201495] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.201608] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.201844] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.201983] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.205035] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.205035] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.205035] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.205035] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.205035] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.205035] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.205035] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.227930] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.227930] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 890.228160] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.228499] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.228986] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.229281] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.229491] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.229920] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.230178] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.334994] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.564740] env[69343]: INFO networking_nsxv3.common.synchronization [None req-fd43d868-8eb2-472d-85dd-9763a4263c2b None None] Enqueued Resource ID: 3134ec68-000d-4aec-b1ba-34d56e83f9f1 with Priority: HIGHEST for action port [ 890.565376] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3134ec68-000d-4aec-b1ba-34d56e83f9f1 with Priority: HIGHEST for action port [ 890.565691] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-3134ec68-000d-4aec-b1ba-34d56e83f9f1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.565839] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3134ec68-000d-4aec-b1ba-34d56e83f9f1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.565909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3134ec68-000d-4aec-b1ba-34d56e83f9f1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.569127] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3134ec68-000d-4aec-b1ba-34d56e83f9f1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.569127] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3134ec68-000d-4aec-b1ba-34d56e83f9f1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.732584] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.732924] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.733093] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.733387] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.733582] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.733823] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010 not found, creating... [ 890.734176] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.734357] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.734512] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.734801] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.734991] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.736322] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.736322] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.736322] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.736322] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.736508] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.736508] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010 is going to be created. [ 890.760323] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.760559] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.760759] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.760985] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.761248] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.761552] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.837484] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.007675] env[69343]: INFO networking_nsxv3.common.synchronization [req-6b103186-5453-4f8a-98f8-059c54544c28 req-861ef031-40cd-4360-ad42-4bed09a58830 tempest-ServerAddressesTestJSON-690527140 tempest-ServerAddressesTestJSON-690527140-project-member] Enqueued Resource ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 with Priority: HIGHEST for action security_group_members [ 891.008316] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 with Priority: HIGHEST for action security_group_members [ 891.008763] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ba723a9-f8bb-4746-b83f-2c283502bde3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.008929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.009045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.009349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.009536] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.009669] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.009760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.009969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.010108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.010241] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ba723a9-f8bb-4746-b83f-2c283502bde3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.074193] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3134ec68-000d-4aec-b1ba-34d56e83f9f1 [ 891.074193] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.074193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.074193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.074193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.074193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.074193] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3134ec68-000d-4aec-b1ba-34d56e83f9f1 already deleted. [ 891.074193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3134ec68-000d-4aec-b1ba-34d56e83f9f1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.341599] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.341765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.342626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.342626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.342626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.342626] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 891.383028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.383345] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.383345] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.384033] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.384033] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.397725] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 891.513988] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.514147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.514222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.514449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.514538] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.514746] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.514848] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.514891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.515058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.515131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.515220] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 is going to be updated. [ 891.548654] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.548654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.548654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.548654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.548654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.563783] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 in Status: IN_PROGRESS for 2s [ 891.595090] env[69343]: INFO networking_nsxv3.common.synchronization [req-c28fc221-f89d-4380-bf72-48e4fc93c9fe req-ef912a01-d969-4fb9-a585-5c1ad6019c96 service nova] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_rules [ 891.595490] env[69343]: INFO networking_nsxv3.common.synchronization [req-c28fc221-f89d-4380-bf72-48e4fc93c9fe req-ef912a01-d969-4fb9-a585-5c1ad6019c96 service nova] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 891.595800] env[69343]: INFO networking_nsxv3.common.synchronization [req-c28fc221-f89d-4380-bf72-48e4fc93c9fe req-ef912a01-d969-4fb9-a585-5c1ad6019c96 service nova] Enqueued Resource ID: 2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010 with Priority: HIGHEST for action port [ 891.597028] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_rules [ 891.597155] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 891.597278] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010 with Priority: HIGHEST for action port [ 891.602669] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.602805] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.602805] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.603400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.603400] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.606920] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.607097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.607284] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.607390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.607496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.607892] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.608031] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.914834] env[69343]: INFO networking_nsxv3.common.synchronization [None req-e8c8d945-8ef7-4ff6-b15e-c0a4a4430cdd tempest-ServerActionsTestOtherA-678333832 tempest-ServerActionsTestOtherA-678333832-project-member] Enqueued Resource ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d with Priority: HIGHEST for action security_group_rules [ 891.915649] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d with Priority: HIGHEST for action security_group_rules [ 891.916332] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.916532] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.916644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.916988] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.917155] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f4a1283-038d-4b9a-8c1a-7e43a4c6645d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.082324] env[69343]: INFO networking_nsxv3.common.synchronization [None req-69734902-c621-435a-ae21-5ea739ff2256 tempest-ServerActionsTestOtherA-678333832 tempest-ServerActionsTestOtherA-678333832-project-member] Enqueued Resource ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d with Priority: HIGHEST for action security_group_rules [ 892.084329] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d with Priority: HIGHEST for action security_group_rules [ 892.084329] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.084329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.111053] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.111204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.117792] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010 with status ACTIVE [ 892.117792] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.117792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.117792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.117792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.117792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.117792] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.117792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.117792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.117792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.117792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.117792] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.117792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.117792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.117792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.117792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.117792] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010 is going to be updated. [ 892.145034] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.145034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.145034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.145034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.145034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.145034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c8bd88d-1c1b-4e69-ad84-aff2f8ee1010" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.437708] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.437916] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.437916] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.438290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.438290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.438290] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d already deleted. [ 892.438469] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.438583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.439088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.439208] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f4a1283-038d-4b9a-8c1a-7e43a4c6645d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.883143] env[69343]: INFO networking_nsxv3.common.synchronization [None req-1e1951c1-ccc0-45a9-a758-5a4154c1a956 None None] Enqueued Resource ID: 9a769c84-faf3-4dd0-8578-ed28b84a91e4 with Priority: HIGHEST for action port [ 892.883143] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a769c84-faf3-4dd0-8578-ed28b84a91e4 with Priority: HIGHEST for action port [ 892.883665] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a769c84-faf3-4dd0-8578-ed28b84a91e4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.884423] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a769c84-faf3-4dd0-8578-ed28b84a91e4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.884681] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a769c84-faf3-4dd0-8578-ed28b84a91e4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.885181] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a769c84-faf3-4dd0-8578-ed28b84a91e4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.885369] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a769c84-faf3-4dd0-8578-ed28b84a91e4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.975322] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.976012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.976012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.976012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.976012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.976012] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d already deleted. [ 892.976012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.389827] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a769c84-faf3-4dd0-8578-ed28b84a91e4 [ 893.390101] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.390237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.390308] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.390587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.390638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.390694] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a769c84-faf3-4dd0-8578-ed28b84a91e4 already deleted. [ 893.390861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a769c84-faf3-4dd0-8578-ed28b84a91e4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.410639] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 893.410855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.411043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.411272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.411485] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.411640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.411718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.411834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.411914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.412051] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.578974] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 in Status: SUCCESS [ 893.579247] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 deletion is rescheduled due to dependency. [ 893.579411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.916463] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.952825] env[69343]: INFO networking_nsxv3.common.synchronization [req-79205631-d83d-4546-b83c-0aed3a57b3bd req-65c5688b-3912-477c-ab61-c509b27ceb91 tempest-ServersWithSpecificFlavorTestJSON-666360316 tempest-ServersWithSpecificFlavorTestJSON-666360316-project-member] Enqueued Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_members [ 893.953425] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_members [ 893.953741] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3ee775-00c0-4c70-a79b-23338c04f67f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.953877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.953934] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.954143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.954303] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.954393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.954462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.954608] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.954716] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.954813] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.289020] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.289020] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-582" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.289020] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-582" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.289020] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-582" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.289020] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.289020] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.289020] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.289020] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.289020] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.289020] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.289791] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 894.290096] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 894.292395] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 894.292395] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.292395] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 894.292395] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 894.312026] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 894.312026] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 894.312026] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 894.312026] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-582" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.312026] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-da4627fe-cc7e-4a9d-87cd-977e6a877f88 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.312026] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-da4627fe-cc7e-4a9d-87cd-977e6a877f88" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.312026] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-da4627fe-cc7e-4a9d-87cd-977e6a877f88" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.312026] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-da4627fe-cc7e-4a9d-87cd-977e6a877f88" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.312026] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da4627fe-cc7e-4a9d-87cd-977e6a877f88',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.423495] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.460746] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.460746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.460746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.460746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.460746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.460746] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.460746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.460746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.460746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.460746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.460746] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f is going to be deleted. [ 894.504732] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.504732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.504732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.504732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.505188] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.505188] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.779051] env[69343]: INFO networking_nsxv3.common.synchronization [req-61e054ce-2bfd-4b54-be3c-0676ba9b9c0a req-66978312-ffc2-4ece-8e19-689b66d1a32b tempest-ServerActionsV293TestJSON-480392759 tempest-ServerActionsV293TestJSON-480392759-project-member] Enqueued Resource ID: b7614721-7a3e-40ba-83da-998503180bf3 with Priority: HIGHEST for action security_group_members [ 894.780531] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7614721-7a3e-40ba-83da-998503180bf3 with Priority: HIGHEST for action security_group_members [ 894.782664] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7614721-7a3e-40ba-83da-998503180bf3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.783232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.783232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.783232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.783442] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.783494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.783524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.783693] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.783782] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.785434] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7614721-7a3e-40ba-83da-998503180bf3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.817200] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.817200] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.817200] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.817200] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.817200] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.817200] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port da4627fe-cc7e-4a9d-87cd-977e6a877f88 not found, creating... [ 894.817200] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.817513] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.817513] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.817594] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.817733] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.818972] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.819295] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.819439] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.819670] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.819810] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.819968] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: da4627fe-cc7e-4a9d-87cd-977e6a877f88 is going to be created. [ 894.845366] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.845575] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.845698] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.845982] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.846230] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.846471] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-da4627fe-cc7e-4a9d-87cd-977e6a877f88" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.924290] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.924505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.924577] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.924799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.925248] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.925248] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 894.958518] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.958689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.958747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.959037] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.959206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.981254] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 895.287169] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.287346] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.287425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.287753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.311524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.311904] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.312075] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.312160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.312405] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.312517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.312624] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7614721-7a3e-40ba-83da-998503180bf3 is going to be updated. [ 895.340609] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.340781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.340831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.341077] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.341236] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.354049] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7614721-7a3e-40ba-83da-998503180bf3 in Status: IN_PROGRESS for 2s [ 896.072883] env[69343]: INFO networking_nsxv3.common.synchronization [req-79205631-d83d-4546-b83c-0aed3a57b3bd req-2ad632a0-e753-4382-88fb-332b9e061e89 service nova] Enqueued Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_rules [ 896.074587] env[69343]: INFO networking_nsxv3.common.synchronization [req-79205631-d83d-4546-b83c-0aed3a57b3bd req-2ad632a0-e753-4382-88fb-332b9e061e89 service nova] Enqueued Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_members [ 896.075662] env[69343]: INFO networking_nsxv3.common.synchronization [req-79205631-d83d-4546-b83c-0aed3a57b3bd req-2ad632a0-e753-4382-88fb-332b9e061e89 service nova] Enqueued Resource ID: da4627fe-cc7e-4a9d-87cd-977e6a877f88 with Priority: HIGHEST for action port [ 896.076329] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_rules [ 896.076447] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_members [ 896.076551] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4627fe-cc7e-4a9d-87cd-977e6a877f88 with Priority: HIGHEST for action port [ 896.076842] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f3ee775-00c0-4c70-a79b-23338c04f67f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.076972] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.078443] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.078443] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.078443] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.078443] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3ee775-00c0-4c70-a79b-23338c04f67f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.078443] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.078443] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.078717] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.078717] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.078778] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.078806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.078947] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.082028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.082028] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.082028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-da4627fe-cc7e-4a9d-87cd-977e6a877f88 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.082028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da4627fe-cc7e-4a9d-87cd-977e6a877f88" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.082028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da4627fe-cc7e-4a9d-87cd-977e6a877f88" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.082028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da4627fe-cc7e-4a9d-87cd-977e6a877f88" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.082028] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da4627fe-cc7e-4a9d-87cd-977e6a877f88',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.581987] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.584784] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da4627fe-cc7e-4a9d-87cd-977e6a877f88 with status ACTIVE [ 896.584784] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.584784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.584784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.584784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.584784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.585044] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.585044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.585117] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.585580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.585580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.585580] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.585708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.585708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.585788] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.586135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.586135] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da4627fe-cc7e-4a9d-87cd-977e6a877f88 is going to be updated. [ 896.587498] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3ee775-00c0-4c70-a79b-23338c04f67f taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.587585] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.611998] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.612139] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.612139] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.612404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.612601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.612846] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da4627fe-cc7e-4a9d-87cd-977e6a877f88" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.994036] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 896.994036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.994208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.994429] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.994625] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.994826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.994895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.995070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.995157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.995432] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.995432] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.091680] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.366303] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7614721-7a3e-40ba-83da-998503180bf3 in Status: SUCCESS [ 897.366654] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7614721-7a3e-40ba-83da-998503180bf3 deletion is rescheduled due to dependency. [ 897.366763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.498023] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.499665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.499665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.499665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.499665] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.499665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.499665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.499665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.499665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.499665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.499957] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.499957] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.499957] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.500153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.500290] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.500290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.500455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.500731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.500731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.500731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.500829] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.595679] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.595679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.595679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.595679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.595679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.595679] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f is going to be created. [ 897.626178] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.626178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.626178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.626178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.626178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.646253] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f in Status: UNINITIALIZED for 2s [ 898.003483] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ff65ed7-3c36-4248-86bb-8bb20a53fde4: rpc.has_security_group_logging(os_id): False [ 898.026379] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.026682] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.026901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.027172] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.058747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.059583] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.060041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.060041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.060322] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.061095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.061595] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.061817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.061925] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.062159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.062282] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.062607] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.062767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.062855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.063060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.063150] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.063241] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 898.137281] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.137281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.137281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.137281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.137281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.153271] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 898.516287] env[69343]: INFO networking_nsxv3.common.synchronization [req-65831a6b-1b85-4448-b58c-952e4d6cd5f3 req-804f28d0-bda7-42ab-b49d-2631aa01c556 tempest-MigrationsAdminTest-544745941 tempest-MigrationsAdminTest-544745941-project-member] Enqueued Resource ID: 1db02b01-820f-4081-802a-12188735ffe1 with Priority: HIGHEST for action security_group_members [ 898.516903] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1db02b01-820f-4081-802a-12188735ffe1 with Priority: HIGHEST for action security_group_members [ 898.518347] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1db02b01-820f-4081-802a-12188735ffe1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.518490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.518561] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.518786] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.518981] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.519045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.519103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.519660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.519660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.519660] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1db02b01-820f-4081-802a-12188735ffe1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.023539] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.023841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.023841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.024071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.047106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.047106] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.047106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.047106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.047411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.047411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.047411] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db02b01-820f-4081-802a-12188735ffe1 is going to be updated. [ 899.080234] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.080234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.080234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.080234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.080234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.091261] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db02b01-820f-4081-802a-12188735ffe1 in Status: IN_PROGRESS for 2s [ 899.657639] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f in Status: SUCCESS [ 899.658032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.658307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.658665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.658996] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.659205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.659504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.659817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.660013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.660196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.660370] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.766056] env[69343]: INFO networking_nsxv3.common.synchronization [req-f5a8d4f5-ec4f-4ff6-a193-82b1cb52227c req-ae167958-5c8d-41a6-99ab-55686b7dddf6 tempest-ServersAdminTestJSON-624451732 tempest-ServersAdminTestJSON-624451732-project-member] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 899.766056] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGHEST for action security_group_members [ 899.766349] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.766494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.766560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.766799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.766958] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.767474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.767474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.767474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.767474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.767622] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.933511] env[69343]: INFO networking_nsxv3.common.synchronization [req-880e7112-7bc9-4c99-bfdd-52df81aa4b84 req-9b601c9d-133b-4d71-9fd6-7a333232df52 tempest-ServerMetadataNegativeTestJSON-38655485 tempest-ServerMetadataNegativeTestJSON-38655485-project-member] Enqueued Resource ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 with Priority: HIGHEST for action security_group_members [ 899.933993] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 with Priority: HIGHEST for action security_group_members [ 899.934397] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5edd58c8-45a0-43c5-b788-4aa742334ad2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.934464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.934508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.934758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.934904] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.935088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.935252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.935402] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.935508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.935630] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5edd58c8-45a0-43c5-b788-4aa742334ad2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.163715] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.169281] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 900.169516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.270109] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.270400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.270572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.270814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.270909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.271150] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.271260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.271329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.271648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.271757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.271855] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be updated. [ 900.284178] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-183 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.284397] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-183" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.284582] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-183" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.284970] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-183" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.288609] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.288976] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.289294] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.289602] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.289840] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.290169] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 900.290410] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 900.290666] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 900.290787] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 900.290986] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 900.291221] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 900.291545] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 900.315298] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.315298] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.315520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.315853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.317265] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.319797] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 900.319797] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 900.319797] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 900.320507] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-183" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.320985] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-9fe222bf-d5cc-49a0-8364-41af67de7016 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.321352] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-9fe222bf-d5cc-49a0-8364-41af67de7016" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.322108] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-9fe222bf-d5cc-49a0-8364-41af67de7016" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.322598] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-9fe222bf-d5cc-49a0-8364-41af67de7016" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.322877] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fe222bf-d5cc-49a0-8364-41af67de7016',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.335554] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: IN_PROGRESS for 2s [ 900.438567] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.438841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.438841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.439098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.439206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.439411] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.439550] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.439550] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.439721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.439800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.439887] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 already deleted. [ 900.439991] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.666496] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f3ee775-00c0-4c70-a79b-23338c04f67f: rpc.has_security_group_logging(os_id): False [ 900.687793] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.687793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.688066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.688289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.688420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.688758] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.688905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.688905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.689124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.689203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.689303] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f is going to be created. [ 900.766260] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.766260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.766349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.766529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.766738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.783641] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f in Status: IN_PROGRESS for 2s [ 900.826369] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.826644] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.826857] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.827324] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.827780] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.827780] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 9fe222bf-d5cc-49a0-8364-41af67de7016 not found, creating... [ 900.828023] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.828260] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.828428] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.828774] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.828941] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.830287] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.830569] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.830728] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.831242] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.831650] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.831892] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 9fe222bf-d5cc-49a0-8364-41af67de7016 is going to be created. [ 900.881659] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.882053] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.882455] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.882738] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.883115] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.883485] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-9fe222bf-d5cc-49a0-8364-41af67de7016" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.105873] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1db02b01-820f-4081-802a-12188735ffe1 in Status: SUCCESS [ 901.105873] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1db02b01-820f-4081-802a-12188735ffe1 deletion is rescheduled due to dependency. [ 901.105873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1db02b01-820f-4081-802a-12188735ffe1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.571853] env[69343]: INFO networking_nsxv3.common.synchronization [req-880e7112-7bc9-4c99-bfdd-52df81aa4b84 req-e55a82fc-637c-4e14-ba27-6cb3af088508 service nova] Enqueued Resource ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 with Priority: HIGHEST for action security_group_rules [ 901.571853] env[69343]: INFO networking_nsxv3.common.synchronization [req-880e7112-7bc9-4c99-bfdd-52df81aa4b84 req-e55a82fc-637c-4e14-ba27-6cb3af088508 service nova] Enqueued Resource ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 with Priority: HIGHEST for action security_group_members [ 901.572143] env[69343]: INFO networking_nsxv3.common.synchronization [req-880e7112-7bc9-4c99-bfdd-52df81aa4b84 req-e55a82fc-637c-4e14-ba27-6cb3af088508 service nova] Enqueued Resource ID: 9fe222bf-d5cc-49a0-8364-41af67de7016 with Priority: HIGHEST for action port [ 901.572594] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 with Priority: HIGHEST for action security_group_rules [ 901.572871] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 with Priority: HIGHEST for action security_group_members [ 901.572922] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fe222bf-d5cc-49a0-8364-41af67de7016 with Priority: HIGHEST for action port [ 901.573406] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5edd58c8-45a0-43c5-b788-4aa742334ad2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.573543] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.573623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.573897] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.573942] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5edd58c8-45a0-43c5-b788-4aa742334ad2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.574825] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5edd58c8-45a0-43c5-b788-4aa742334ad2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.574939] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.575086] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.575221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.575379] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.575476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.575537] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.575681] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.575766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.575856] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5edd58c8-45a0-43c5-b788-4aa742334ad2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.576671] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fe222bf-d5cc-49a0-8364-41af67de7016 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.576811] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fe222bf-d5cc-49a0-8364-41af67de7016" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.576811] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fe222bf-d5cc-49a0-8364-41af67de7016" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.577072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fe222bf-d5cc-49a0-8364-41af67de7016" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.577072] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fe222bf-d5cc-49a0-8364-41af67de7016',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.079436] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5edd58c8-45a0-43c5-b788-4aa742334ad2 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.079436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.079548] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5edd58c8-45a0-43c5-b788-4aa742334ad2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.083442] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fe222bf-d5cc-49a0-8364-41af67de7016 with status ACTIVE [ 902.083442] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.083442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.083442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.083442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.083442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.083442] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.083442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.083442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.083442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.083442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.084598] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.084598] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.084598] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.084598] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.088019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.088019] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fe222bf-d5cc-49a0-8364-41af67de7016 is going to be updated. [ 902.116203] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.116340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.116418] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.116653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.116943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.117191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fe222bf-d5cc-49a0-8364-41af67de7016" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.347035] env[69343]: INFO networking_nsxv3.common.synchronization [req-b4b6fc23-85cc-4cae-9f7b-24633d14da88 req-05f6c4ff-5fc7-4ed0-85be-20a276b80a7b tempest-ServersAdminNegativeTestJSON-480893068 tempest-ServersAdminNegativeTestJSON-480893068-project-member] Enqueued Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGHEST for action security_group_members [ 902.347035] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGHEST for action security_group_members [ 902.347035] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.347035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.347035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.347035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.347035] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.347035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.351663] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.351663] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.351663] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.351663] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.353338] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a in Status: SUCCESS [ 902.353338] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a deletion is rescheduled due to dependency. [ 902.353338] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.581988] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5edd58c8-45a0-43c5-b788-4aa742334ad2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.800302] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f in Status: SUCCESS [ 902.802096] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.853353] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.854260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.858025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.858025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.858025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.858025] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.858025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.858025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.858025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.858025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.858025] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39709bac-2d5f-45f1-8871-b8dc216058be is going to be updated. [ 902.891221] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.891221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.891221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.891221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.891221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.905219] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39709bac-2d5f-45f1-8871-b8dc216058be in Status: IN_PROGRESS for 2s [ 903.084957] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.085133] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.085205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.085422] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.085511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.085609] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 is going to be created. [ 903.110125] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.110125] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.110323] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.111470] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.111470] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.121178] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 in Status: UNINITIALIZED for 2s [ 903.165030] env[69343]: INFO networking_nsxv3.common.synchronization [req-0aa65129-08e5-42da-b18c-c1903c320933 req-e46376ff-611b-4c6c-bf0e-db8e4c34a134 tempest-ImagesTestJSON-628353040 tempest-ImagesTestJSON-628353040-project-member] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 903.165030] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 903.165030] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.165030] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.165030] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.165030] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.165030] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.165030] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.165030] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.165030] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.165030] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.165030] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.559975] env[69343]: INFO networking_nsxv3.common.synchronization [req-4443ccf0-abcf-4264-b8f6-039934e61f6f req-537651ef-6272-425d-aa73-1af8a49fe6f1 tempest-ListServerFiltersTestJSON-1584999217 tempest-ListServerFiltersTestJSON-1584999217-project-member] Enqueued Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 903.560195] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5de742-586a-4eea-8d29-9efb080dd556 with Priority: HIGHEST for action security_group_members [ 903.560548] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5de742-586a-4eea-8d29-9efb080dd556 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.560661] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.560727] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.560943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.562345] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.562528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.562611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.562822] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.564026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.564825] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac5de742-586a-4eea-8d29-9efb080dd556',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.669303] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.669634] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.669634] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.669824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.669918] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.670143] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.670240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.670301] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.670475] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.670553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.670692] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 903.706367] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.706367] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.706367] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.706651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.706680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.716828] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 904.068532] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.068720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.068865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.069013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.090179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.090435] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.090557] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.090642] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.091084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.091181] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.091658] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac5de742-586a-4eea-8d29-9efb080dd556 is going to be updated. [ 904.119059] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.119059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.119059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.119059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.119059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.131221] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: IN_PROGRESS for 2s [ 904.453259] env[69343]: INFO networking_nsxv3.common.synchronization [req-6c5f5e59-6339-4965-bde7-c0c7302d545c req-ea6eb10d-4583-4660-92d9-a28781b0477f tempest-InstanceActionsTestJSON-1536384266 tempest-InstanceActionsTestJSON-1536384266-project-member] Enqueued Resource ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a with Priority: HIGHEST for action security_group_members [ 904.454600] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a with Priority: HIGHEST for action security_group_members [ 904.454600] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc3164ca-a0f8-4382-a1f9-ece149336a1a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.454600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.454600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.454896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.454896] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.454989] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.455106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.455225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.455325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.455405] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc3164ca-a0f8-4382-a1f9-ece149336a1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.704838] env[69343]: INFO networking_nsxv3.common.synchronization [req-9c4579f5-b83a-48d2-9cc7-73fa2b733f16 req-92d84bb5-3981-4db8-8058-4eceea650a7f tempest-ServersTestJSON-245111932 tempest-ServersTestJSON-245111932-project-member] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 904.705566] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 904.705908] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.707921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.708182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.708352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.708567] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.708694] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.708763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.708952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.709074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.709182] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.879894] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.880133] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-781" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.880266] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-781" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.880608] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-781" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.880882] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.881185] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.881372] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.881913] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.882159] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.882575] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.882787] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.882955] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.883129] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.883343] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.883490] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.883721] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.906238] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.906238] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 904.906238] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.906238] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-781" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.906238] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-aa464498-5aab-4473-820d-5c2bf16868a9 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.906238] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-aa464498-5aab-4473-820d-5c2bf16868a9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.906238] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-aa464498-5aab-4473-820d-5c2bf16868a9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.909938] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-aa464498-5aab-4473-820d-5c2bf16868a9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.909938] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa464498-5aab-4473-820d-5c2bf16868a9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.918567] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39709bac-2d5f-45f1-8871-b8dc216058be in Status: SUCCESS [ 904.919632] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39709bac-2d5f-45f1-8871-b8dc216058be deletion is rescheduled due to dependency. [ 904.919632] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.959248] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.959248] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.960584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.960584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.960584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.960584] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.960584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.960584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.960584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.960584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.960584] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a already deleted. [ 904.960584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.132297] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 in Status: SUCCESS [ 905.132530] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.132695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.132920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.133135] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.133252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.133317] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.133469] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.133551] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.133636] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.133728] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5edd58c8-45a0-43c5-b788-4aa742334ad2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.213137] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.413688] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.414202] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.414564] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.415051] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.415376] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.415795] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port aa464498-5aab-4473-820d-5c2bf16868a9 not found, creating... [ 905.416332] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.417457] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.417457] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.420507] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.420507] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.420507] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.420507] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.420507] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.420507] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.420507] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.420507] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: aa464498-5aab-4473-820d-5c2bf16868a9 is going to be created. [ 905.442276] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.442276] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.442276] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.442276] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.442276] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.442276] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-aa464498-5aab-4473-820d-5c2bf16868a9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.447584] env[69343]: INFO networking_nsxv3.common.synchronization [None req-2aadbba2-e6af-465f-a753-1fd20b512766 tempest-ServerActionsTestJSON-1397784852 tempest-ServerActionsTestJSON-1397784852-project-member] Enqueued Resource ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 with Priority: HIGHEST for action security_group_rules [ 905.447860] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 with Priority: HIGHEST for action security_group_rules [ 905.448301] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.448457] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.448548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.449095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.449095] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.606127] env[69343]: INFO networking_nsxv3.common.synchronization [None req-39c76e43-6e1c-4b88-80f8-3aaf7f4e18f4 tempest-ServerActionsTestJSON-1397784852 tempest-ServerActionsTestJSON-1397784852-project-member] Enqueued Resource ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 with Priority: HIGHEST for action security_group_rules [ 905.606923] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 with Priority: HIGHEST for action security_group_rules [ 905.607293] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.607407] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.635774] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5edd58c8-45a0-43c5-b788-4aa742334ad2 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.635934] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.636016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.636273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.636455] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.636598] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.636642] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.636799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.636894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.636996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.637160] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5edd58c8-45a0-43c5-b788-4aa742334ad2 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.637256] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.637317] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.637462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.637602] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.637693] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.637751] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.637917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.638012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.638103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.638195] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5edd58c8-45a0-43c5-b788-4aa742334ad2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.714926] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.729049] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 905.729242] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b deletion is rescheduled due to dependency. [ 905.729404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.973829] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.974020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.974099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.974315] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.974409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.974506] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 already deleted. [ 905.974592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.975255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.975255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.975255] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.143359] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5edd58c8-45a0-43c5-b788-4aa742334ad2: rpc.has_security_group_logging(os_id): False [ 906.146611] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5de742-586a-4eea-8d29-9efb080dd556 in Status: SUCCESS [ 906.146611] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac5de742-586a-4eea-8d29-9efb080dd556 deletion is rescheduled due to dependency. [ 906.146611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5de742-586a-4eea-8d29-9efb080dd556" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.164917] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.165145] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.165219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.165450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.165569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.165749] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.165845] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.165905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.166184] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.166184] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.167328] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.168861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.168861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.168861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.168861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.173134] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.173134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.173134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.173134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.173134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.173134] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 is going to be created. [ 906.220483] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.221715] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.221715] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.222390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.224231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.224457] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 906.229493] env[69343]: INFO networking_nsxv3.common.synchronization [req-6c5f5e59-6339-4965-bde7-c0c7302d545c req-b163e0c3-4c5c-4488-93ab-b43e06f62ce9 service nova] Enqueued Resource ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a with Priority: HIGHEST for action security_group_rules [ 906.229493] env[69343]: INFO networking_nsxv3.common.synchronization [req-6c5f5e59-6339-4965-bde7-c0c7302d545c req-b163e0c3-4c5c-4488-93ab-b43e06f62ce9 service nova] Enqueued Resource ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a with Priority: HIGHEST for action security_group_members [ 906.229493] env[69343]: INFO networking_nsxv3.common.synchronization [req-6c5f5e59-6339-4965-bde7-c0c7302d545c req-b163e0c3-4c5c-4488-93ab-b43e06f62ce9 service nova] Enqueued Resource ID: aa464498-5aab-4473-820d-5c2bf16868a9 with Priority: HIGHEST for action port [ 906.229728] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a with Priority: HIGHEST for action security_group_rules [ 906.229824] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a with Priority: HIGHEST for action security_group_members [ 906.229926] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa464498-5aab-4473-820d-5c2bf16868a9 with Priority: HIGHEST for action port [ 906.232736] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc3164ca-a0f8-4382-a1f9-ece149336a1a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.233447] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.233525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.233809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.233892] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc3164ca-a0f8-4382-a1f9-ece149336a1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.237295] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc3164ca-a0f8-4382-a1f9-ece149336a1a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.237295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.237295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.237295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.237295] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.237295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.237295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.237295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.237295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.237295] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc3164ca-a0f8-4382-a1f9-ece149336a1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.242289] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa464498-5aab-4473-820d-5c2bf16868a9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.242289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa464498-5aab-4473-820d-5c2bf16868a9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.242289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa464498-5aab-4473-820d-5c2bf16868a9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.242289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa464498-5aab-4473-820d-5c2bf16868a9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.242289] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa464498-5aab-4473-820d-5c2bf16868a9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.249716] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.249884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.249967] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.250253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.250482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.264662] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 in Status: IN_PROGRESS for 2s [ 906.266786] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.266994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.270403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.270403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.270403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.283354] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 906.498537] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.498709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.498800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.499111] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.499184] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.499306] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 already deleted. [ 906.499378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.662417] env[69343]: INFO networking_nsxv3.common.synchronization [req-ce0e9790-a8fa-4b38-bc40-d0ffc4a26291 req-6ed996da-77bd-4d7b-ac72-9adbcadcf65a tempest-ServerActionsTestOtherB-1339566970 tempest-ServerActionsTestOtherB-1339566970-project-member] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 906.665677] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 906.666044] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.666165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.666237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.666443] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.666605] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.666706] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.666914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.666914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.666974] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.667084] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.745940] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa464498-5aab-4473-820d-5c2bf16868a9 with status ACTIVE [ 906.746290] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.746381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.746429] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.746783] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.747695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.747822] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.747927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.748034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.748191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.748273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.748464] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.748576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.748693] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.748879] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.748929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.749077] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa464498-5aab-4473-820d-5c2bf16868a9 is going to be updated. [ 906.750501] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc3164ca-a0f8-4382-a1f9-ece149336a1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.751612] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc3164ca-a0f8-4382-a1f9-ece149336a1a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.751749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.777414] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.777562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.777638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.777857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.778009] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.778186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa464498-5aab-4473-820d-5c2bf16868a9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.170572] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.171038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.171038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.171165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.195021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.195021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.195021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.195021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.195021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.195021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.195021] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 is going to be updated. [ 907.223087] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.223087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.223248] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.223305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.223447] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.232329] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: IN_PROGRESS for 2s [ 907.252358] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc3164ca-a0f8-4382-a1f9-ece149336a1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.758504] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.758504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.758504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.758504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.758504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.758504] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a is going to be created. [ 907.784271] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.784444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.784479] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.785051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.785051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.794977] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a in Status: UNINITIALIZED for 2s [ 908.277985] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 in Status: SUCCESS [ 908.278734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.293160] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 908.293412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.242291] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: SUCCESS [ 909.242679] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 deletion is rescheduled due to dependency. [ 909.242679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.805527] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a in Status: SUCCESS [ 909.805766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.805930] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.806168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.806365] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.806481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.806565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.806735] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.806821] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.806907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.806998] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc3164ca-a0f8-4382-a1f9-ece149336a1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.311053] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc3164ca-a0f8-4382-a1f9-ece149336a1a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.311053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.311053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.311053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.311053] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.311053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.311053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.311053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.311053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.311053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.311053] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc3164ca-a0f8-4382-a1f9-ece149336a1a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.311924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.311924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.311924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.311924] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.312055] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.312096] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.312276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.312362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.312469] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.312606] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc3164ca-a0f8-4382-a1f9-ece149336a1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.815076] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc3164ca-a0f8-4382-a1f9-ece149336a1a: rpc.has_security_group_logging(os_id): False [ 910.838609] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.838837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.838901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.839484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.839484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.839484] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.839687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.839687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.839748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.839957] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.840077] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.840178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.840242] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.840387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.840463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.840645] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.840782] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.840822] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.840945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.841205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.841308] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a is going to be created. [ 910.940205] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.940416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.940531] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.940842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.941137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.962860] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a in Status: IN_PROGRESS for 2s [ 911.667086] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 911.667356] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 912.950451] env[69343]: INFO networking_nsxv3.common.synchronization [req-8b8ee6c4-cffc-4ffb-ab5e-3f24416a9500 req-ea7e4381-64de-4a72-92fb-3004a30bfd9b tempest-AttachVolumeTestJSON-1370042024 tempest-AttachVolumeTestJSON-1370042024-project-member] Enqueued Resource ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b with Priority: HIGHEST for action security_group_members [ 912.951081] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b with Priority: HIGHEST for action security_group_members [ 912.951401] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.951549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.951624] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.954927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.954927] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.954927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.954927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.954927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.954927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.954927] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.977867] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a in Status: SUCCESS [ 912.978173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.249694] env[69343]: INFO networking_nsxv3.common.synchronization [req-9a2656e3-3730-4806-ae35-ae2e15ef472d req-ee57cfd0-73c6-43b3-b1d7-8f6c60411759 tempest-ServerMetadataNegativeTestJSON-38655485 tempest-ServerMetadataNegativeTestJSON-38655485-project-member] Enqueued Resource ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 with Priority: HIGHEST for action security_group_members [ 913.250292] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 with Priority: HIGHEST for action security_group_members [ 913.250610] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5edd58c8-45a0-43c5-b788-4aa742334ad2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.250744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.250815] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.251839] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.252021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.252137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.252208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.252393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.252550] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.252603] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5edd58c8-45a0-43c5-b788-4aa742334ad2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.455231] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.455396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.455446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.455667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.478689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.478796] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.478909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.478969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.479218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.479319] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.479438] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b is going to be updated. [ 913.504135] env[69343]: INFO networking_nsxv3.common.synchronization [req-8e33e9ce-bbf1-4f12-a882-0d8cfc4429a7 req-41e6f05a-13d2-4a02-a10c-69362757c884 tempest-InstanceActionsV221TestJSON-1758791130 tempest-InstanceActionsV221TestJSON-1758791130-project-member] Enqueued Resource ID: 0c195ad8-d052-4923-b668-42944e44042c with Priority: HIGHEST for action security_group_members [ 913.504826] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c195ad8-d052-4923-b668-42944e44042c with Priority: HIGHEST for action security_group_members [ 913.507911] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c195ad8-d052-4923-b668-42944e44042c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.507911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.507911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.507911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.507911] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.507911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.507911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.507911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.507911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.507911] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c195ad8-d052-4923-b668-42944e44042c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.512229] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.512352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.512425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.512613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.512756] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.524827] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b in Status: IN_PROGRESS for 2s [ 913.755390] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.756053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.756053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.758719] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.758719] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.758719] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.758719] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.758719] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.758719] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.758719] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.758719] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 is going to be updated. [ 913.792064] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.792064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.792064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.792064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.792064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.801424] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 in Status: IN_PROGRESS for 2s [ 914.009872] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.010498] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.011902] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.011902] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.011902] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.011902] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.011902] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.011902] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.011902] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.011902] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.011902] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c195ad8-d052-4923-b668-42944e44042c already deleted. [ 914.011902] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.063044] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.063948] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-201" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.063948] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-201" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.063948] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-201" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.064127] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.064297] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.064482] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.064754] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.064964] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.065311] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 914.065488] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 914.065630] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 914.065808] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 914.066148] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 914.066328] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 914.066514] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 914.085808] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 914.085983] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 914.086215] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 914.086428] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-201" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.086795] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-f07f0b3d-f71e-489d-978f-35602dbe52e5 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.086986] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-f07f0b3d-f71e-489d-978f-35602dbe52e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.087127] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-f07f0b3d-f71e-489d-978f-35602dbe52e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.087447] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-f07f0b3d-f71e-489d-978f-35602dbe52e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.088514] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f07f0b3d-f71e-489d-978f-35602dbe52e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.597030] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.597030] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.597030] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.597030] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.597030] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.597030] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port f07f0b3d-f71e-489d-978f-35602dbe52e5 not found, creating... [ 914.597030] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.597030] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.597030] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.597030] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.598353] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.599712] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.599892] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.600030] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.601659] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.602217] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.602426] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: f07f0b3d-f71e-489d-978f-35602dbe52e5 is going to be created. [ 914.637128] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.637359] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.638062] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.642030] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.642030] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.642030] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-f07f0b3d-f71e-489d-978f-35602dbe52e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.190516] env[69343]: INFO networking_nsxv3.common.synchronization [None req-efb4316a-b176-4807-a6cc-050d880d5759 None None] Enqueued Resource ID: 61d2517b-b041-4619-aa12-a40be35e35d4 with Priority: HIGHEST for action port [ 915.191536] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61d2517b-b041-4619-aa12-a40be35e35d4 with Priority: HIGHEST for action port [ 915.191536] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-61d2517b-b041-4619-aa12-a40be35e35d4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.191536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61d2517b-b041-4619-aa12-a40be35e35d4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.191722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61d2517b-b041-4619-aa12-a40be35e35d4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.191912] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61d2517b-b041-4619-aa12-a40be35e35d4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.192433] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61d2517b-b041-4619-aa12-a40be35e35d4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.536832] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b in Status: SUCCESS [ 915.537060] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b deletion is rescheduled due to dependency. [ 915.537192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.694424] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61d2517b-b041-4619-aa12-a40be35e35d4 [ 915.698137] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.698137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.698137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.698137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.698137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.698137] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61d2517b-b041-4619-aa12-a40be35e35d4 already deleted. [ 915.698137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61d2517b-b041-4619-aa12-a40be35e35d4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.812536] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 in Status: SUCCESS [ 915.812869] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 deletion is rescheduled due to dependency. [ 915.812869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.960889] env[69343]: INFO networking_nsxv3.common.synchronization [req-8e33e9ce-bbf1-4f12-a882-0d8cfc4429a7 req-60be2659-f820-4f83-aef9-fc442f936743 service nova] Enqueued Resource ID: 0c195ad8-d052-4923-b668-42944e44042c with Priority: HIGHEST for action security_group_rules [ 915.961086] env[69343]: INFO networking_nsxv3.common.synchronization [req-8e33e9ce-bbf1-4f12-a882-0d8cfc4429a7 req-60be2659-f820-4f83-aef9-fc442f936743 service nova] Enqueued Resource ID: 0c195ad8-d052-4923-b668-42944e44042c with Priority: HIGHEST for action security_group_members [ 915.961548] env[69343]: INFO networking_nsxv3.common.synchronization [req-8e33e9ce-bbf1-4f12-a882-0d8cfc4429a7 req-60be2659-f820-4f83-aef9-fc442f936743 service nova] Enqueued Resource ID: f07f0b3d-f71e-489d-978f-35602dbe52e5 with Priority: HIGHEST for action port [ 915.961548] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c195ad8-d052-4923-b668-42944e44042c with Priority: HIGHEST for action security_group_rules [ 915.961747] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c195ad8-d052-4923-b668-42944e44042c with Priority: HIGHEST for action security_group_members [ 915.961857] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f07f0b3d-f71e-489d-978f-35602dbe52e5 with Priority: HIGHEST for action port [ 915.962488] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c195ad8-d052-4923-b668-42944e44042c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.967041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.967041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.967041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.967041] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c195ad8-d052-4923-b668-42944e44042c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.967041] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c195ad8-d052-4923-b668-42944e44042c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.967041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.967041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.967041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.967041] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.967041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.967041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.967041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.967041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.967041] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c195ad8-d052-4923-b668-42944e44042c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.967041] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-f07f0b3d-f71e-489d-978f-35602dbe52e5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.967041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f07f0b3d-f71e-489d-978f-35602dbe52e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.967041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f07f0b3d-f71e-489d-978f-35602dbe52e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.967041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f07f0b3d-f71e-489d-978f-35602dbe52e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.967041] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f07f0b3d-f71e-489d-978f-35602dbe52e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.007987] env[69343]: INFO networking_nsxv3.common.synchronization [req-f0fe0759-738d-439b-9d50-820c325e92c8 req-4ad63c1c-9ce4-4eb1-9712-c4c0cf772678 tempest-ServerActionsTestOtherA-678333832 tempest-ServerActionsTestOtherA-678333832-project-member] Enqueued Resource ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d with Priority: HIGHEST for action security_group_members [ 916.008535] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d with Priority: HIGHEST for action security_group_members [ 916.009506] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.009506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.009650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.010310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.010508] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.010623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.010691] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.010865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.010953] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.011073] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f4a1283-038d-4b9a-8c1a-7e43a4c6645d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.471461] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c195ad8-d052-4923-b668-42944e44042c taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.471868] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.471868] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c195ad8-d052-4923-b668-42944e44042c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.473687] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-184 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.473687] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.473687] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.473884] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.474310] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.474542] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.474645] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.474923] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.475056] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.475276] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 916.475395] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 916.475511] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 916.475628] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 916.475746] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 916.475854] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 916.475993] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 916.477253] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f07f0b3d-f71e-489d-978f-35602dbe52e5 with status ACTIVE [ 916.477424] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.477531] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.477619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.477782] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.477880] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.478129] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.478232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.478295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.478464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.478547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.478812] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.478856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.478884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.479026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.479105] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.479189] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f07f0b3d-f71e-489d-978f-35602dbe52e5 is going to be updated. [ 916.502250] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 916.502250] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 916.502426] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 916.503518] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.503706] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-d43e8bdc-8ee6-4fd5-a611-9032905c2d17 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.503846] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-d43e8bdc-8ee6-4fd5-a611-9032905c2d17" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.504083] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-d43e8bdc-8ee6-4fd5-a611-9032905c2d17" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.504351] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-d43e8bdc-8ee6-4fd5-a611-9032905c2d17" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.504985] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d43e8bdc-8ee6-4fd5-a611-9032905c2d17',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.506600] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.506808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.506808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.507496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.507496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.507496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f07f0b3d-f71e-489d-978f-35602dbe52e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.515054] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.515054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.515054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.515658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.516410] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.516410] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.516410] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.516920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.517179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.517549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.517549] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d already deleted. [ 916.517549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.977712] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c195ad8-d052-4923-b668-42944e44042c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.009480] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.009480] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.009480] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.009752] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.010012] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.010328] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port d43e8bdc-8ee6-4fd5-a611-9032905c2d17 not found, creating... [ 917.010328] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.010469] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.010659] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.014031] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.014031] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.014031] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.014031] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.014031] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.014031] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.014031] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.014031] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: d43e8bdc-8ee6-4fd5-a611-9032905c2d17 is going to be created. [ 917.037054] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.037054] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.037054] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.037054] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.037054] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.037054] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-d43e8bdc-8ee6-4fd5-a611-9032905c2d17" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.247317] env[69343]: INFO networking_nsxv3.common.synchronization [None req-c15b0dd0-e8cc-46c4-bd02-37e0c6dbc3d6 tempest-AttachVolumeNegativeTest-1961671669 tempest-AttachVolumeNegativeTest-1961671669-project-member] Enqueued Resource ID: 7532335d-79e6-454d-9693-a5b2f8a9923a with Priority: HIGHEST for action security_group_rules [ 917.247317] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7532335d-79e6-454d-9693-a5b2f8a9923a with Priority: HIGHEST for action security_group_rules [ 917.247317] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7532335d-79e6-454d-9693-a5b2f8a9923a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.247317] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.247565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.247956] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.248250] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7532335d-79e6-454d-9693-a5b2f8a9923a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.369525] env[69343]: INFO networking_nsxv3.common.synchronization [None req-be7520a4-5baf-4f85-9f35-9393ebe29bae tempest-AttachVolumeNegativeTest-1961671669 tempest-AttachVolumeNegativeTest-1961671669-project-member] Enqueued Resource ID: 7532335d-79e6-454d-9693-a5b2f8a9923a with Priority: HIGHEST for action security_group_rules [ 917.370790] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7532335d-79e6-454d-9693-a5b2f8a9923a with Priority: HIGHEST for action security_group_rules [ 917.371191] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7532335d-79e6-454d-9693-a5b2f8a9923a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.371414] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.480553] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.487231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.487231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.487231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.487388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.487744] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c195ad8-d052-4923-b668-42944e44042c is going to be created. [ 917.518038] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.518038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.518038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.518038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.518038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.526096] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c195ad8-d052-4923-b668-42944e44042c in Status: UNINITIALIZED for 2s [ 917.669522] env[69343]: INFO networking_nsxv3.common.synchronization [None req-ab13d0f3-51dd-4b17-af42-db72f5fcfea3 None None] Enqueued Resource ID: b3eda3ba-20c6-4340-8675-9d25dbfeb893 with Priority: HIGHEST for action port [ 917.670168] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3eda3ba-20c6-4340-8675-9d25dbfeb893 with Priority: HIGHEST for action port [ 917.670490] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3eda3ba-20c6-4340-8675-9d25dbfeb893 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.670611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3eda3ba-20c6-4340-8675-9d25dbfeb893" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.670677] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3eda3ba-20c6-4340-8675-9d25dbfeb893" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.671033] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3eda3ba-20c6-4340-8675-9d25dbfeb893" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.671620] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3eda3ba-20c6-4340-8675-9d25dbfeb893',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.774500] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.774683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.774683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.774906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.775619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.775767] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7532335d-79e6-454d-9693-a5b2f8a9923a already deleted. [ 917.775849] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.776013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.776219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.776307] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7532335d-79e6-454d-9693-a5b2f8a9923a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.787796] env[69343]: INFO networking_nsxv3.common.synchronization [req-f0fe0759-738d-439b-9d50-820c325e92c8 req-9fc1bba1-5eca-459e-874f-dc662164d44d service nova] Enqueued Resource ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d with Priority: HIGHEST for action security_group_rules [ 917.787988] env[69343]: INFO networking_nsxv3.common.synchronization [req-f0fe0759-738d-439b-9d50-820c325e92c8 req-9fc1bba1-5eca-459e-874f-dc662164d44d service nova] Enqueued Resource ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d with Priority: HIGHEST for action security_group_members [ 917.788147] env[69343]: INFO networking_nsxv3.common.synchronization [req-f0fe0759-738d-439b-9d50-820c325e92c8 req-9fc1bba1-5eca-459e-874f-dc662164d44d service nova] Enqueued Resource ID: d43e8bdc-8ee6-4fd5-a611-9032905c2d17 with Priority: HIGHEST for action port [ 917.788678] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d with Priority: HIGHEST for action security_group_rules [ 917.788811] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d with Priority: HIGHEST for action security_group_members [ 917.788903] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43e8bdc-8ee6-4fd5-a611-9032905c2d17 with Priority: HIGHEST for action port [ 917.792410] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.792571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.792667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.792855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.792942] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f4a1283-038d-4b9a-8c1a-7e43a4c6645d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.795116] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.795280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.795313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.795496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.795665] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.795766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.795830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.795980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.796891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.796891] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f4a1283-038d-4b9a-8c1a-7e43a4c6645d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.798191] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-d43e8bdc-8ee6-4fd5-a611-9032905c2d17 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.798365] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d43e8bdc-8ee6-4fd5-a611-9032905c2d17" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.798401] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d43e8bdc-8ee6-4fd5-a611-9032905c2d17" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.798545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d43e8bdc-8ee6-4fd5-a611-9032905c2d17" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.798616] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d43e8bdc-8ee6-4fd5-a611-9032905c2d17',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.174687] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3eda3ba-20c6-4340-8675-9d25dbfeb893 [ 918.174687] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.174687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.174687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.174687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.174687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.174687] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3eda3ba-20c6-4340-8675-9d25dbfeb893 already deleted. [ 918.174687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3eda3ba-20c6-4340-8675-9d25dbfeb893" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.296471] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.296471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.298409] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.298671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.303212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.303212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.303212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.303212] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7532335d-79e6-454d-9693-a5b2f8a9923a already deleted. [ 918.303212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.303212] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f4a1283-038d-4b9a-8c1a-7e43a4c6645d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.303212] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d43e8bdc-8ee6-4fd5-a611-9032905c2d17 with status ACTIVE [ 918.306724] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.306724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.306724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.306724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.306724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.306724] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.306724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.306724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.306724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.306724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.306724] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.306724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.306724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.306724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.306724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.306724] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d43e8bdc-8ee6-4fd5-a611-9032905c2d17 is going to be updated. [ 918.326769] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.326769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.326769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.326769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.326769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.326769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d43e8bdc-8ee6-4fd5-a611-9032905c2d17" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.807585] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f4a1283-038d-4b9a-8c1a-7e43a4c6645d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.311021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.311277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.311277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.311481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.311596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.311698] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d is going to be created. [ 919.352183] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.352340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.352380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.353102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.353102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.362677] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d in Status: UNINITIALIZED for 2s [ 919.540505] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c195ad8-d052-4923-b668-42944e44042c in Status: SUCCESS [ 919.540505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.540505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.540786] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.540950] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.541129] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.541313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.541544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.541739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.541801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.541956] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c195ad8-d052-4923-b668-42944e44042c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.045690] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c195ad8-d052-4923-b668-42944e44042c taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.045984] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.046425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.046425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.047273] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.047273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.047273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.047273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.047576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.047576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.049600] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c195ad8-d052-4923-b668-42944e44042c taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.049600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.049600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.049600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.049600] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.049600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.049600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.049600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.049600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.049600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.049600] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c195ad8-d052-4923-b668-42944e44042c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.552307] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c195ad8-d052-4923-b668-42944e44042c: rpc.has_security_group_logging(os_id): False [ 920.572069] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.572069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.572069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.572345] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.572345] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.572480] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.572599] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.572709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.572822] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.572900] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.573104] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.573327] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.573327] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.573435] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.573477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.573676] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.573772] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.573834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.574021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.574129] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.574186] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c195ad8-d052-4923-b668-42944e44042c is going to be created. [ 920.646955] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.647149] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.647216] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.647404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.648068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.662953] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c195ad8-d052-4923-b668-42944e44042c in Status: IN_PROGRESS for 2s [ 921.376200] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d in Status: SUCCESS [ 921.376541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.377190] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.377190] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.377492] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.377677] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.378176] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.378176] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.378316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.378373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.378654] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f4a1283-038d-4b9a-8c1a-7e43a4c6645d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.880937] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f4a1283-038d-4b9a-8c1a-7e43a4c6645d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.386346] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d: rpc.has_security_group_logging(os_id): False [ 922.405855] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.405855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.405855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.405855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.405855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.405855] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.405855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.405855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.405855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.405855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.405855] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d is going to be created. [ 922.468771] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.468771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.468771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.468771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.468771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.479085] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d in Status: IN_PROGRESS for 2s [ 922.677970] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c195ad8-d052-4923-b668-42944e44042c in Status: SUCCESS [ 922.679389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.790678] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 922.790678] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 922.830208] env[69343]: INFO networking_nsxv3.common.synchronization [req-08ffb0be-262f-4828-aca5-5fa6b6ee9f33 req-cac5f563-f6f4-4a58-922d-29a1023f5b88 tempest-InstanceActionsTestJSON-1536384266 tempest-InstanceActionsTestJSON-1536384266-project-member] Enqueued Resource ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a with Priority: HIGHEST for action security_group_members [ 922.833102] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a with Priority: HIGHEST for action security_group_members [ 922.833102] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc3164ca-a0f8-4382-a1f9-ece149336a1a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.833102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.833102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.833102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.833102] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.833102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.833102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.833102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.833102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.833572] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc3164ca-a0f8-4382-a1f9-ece149336a1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.342353] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.342353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.342353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.342353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.342353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.342353] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.342353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.342353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.342353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.342353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.342353] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a is going to be updated. [ 923.373123] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.373123] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.373123] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.373123] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.373123] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.385474] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a in Status: IN_PROGRESS for 2s [ 924.362281] env[69343]: INFO networking_nsxv3.common.synchronization [req-c2885f72-7767-498e-9af6-37550eec6bd8 req-e82c1abe-1fb1-4bcc-96d6-a170fed84e18 tempest-ImagesTestJSON-628353040 tempest-ImagesTestJSON-628353040-project-member] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 924.364075] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 924.364698] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.364698] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.364698] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.364901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.364975] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.365086] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.365148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.365296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.365379] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.365471] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.495181] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d in Status: SUCCESS [ 924.495453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.871812] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.872280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.873048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.873319] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.873424] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.873646] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.873761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.873828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.873999] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.874103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.874196] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 924.910769] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.910964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.911274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.911540] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.911879] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.915756] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-308 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.915950] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.916090] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.916412] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.916671] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.916834] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.916953] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.917202] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.917349] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.917613] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 924.917735] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 924.917851] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 924.917964] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 924.918094] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 924.918209] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 924.918344] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 924.923522] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 924.935808] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 924.935996] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 924.936177] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 924.936394] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-308" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.936715] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.936896] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.937034] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.937371] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.937527] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.398311] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a in Status: SUCCESS [ 925.398617] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a deletion is rescheduled due to dependency. [ 925.398750] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.440465] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.440796] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.441047] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.441482] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.441809] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.442089] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3 not found, creating... [ 925.442541] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.442830] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.443079] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.443480] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.443763] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.444309] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.444506] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.444638] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.444888] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.445062] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.445329] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3 is going to be created. [ 925.467743] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.467967] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.468325] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.468646] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.468902] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.469174] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.181597] env[69343]: INFO networking_nsxv3.common.synchronization [req-c2885f72-7767-498e-9af6-37550eec6bd8 req-29ccce07-f321-4cf6-8a86-dcba22f14855 service nova] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_rules [ 926.181597] env[69343]: INFO networking_nsxv3.common.synchronization [req-c2885f72-7767-498e-9af6-37550eec6bd8 req-29ccce07-f321-4cf6-8a86-dcba22f14855 service nova] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 926.181597] env[69343]: INFO networking_nsxv3.common.synchronization [req-c2885f72-7767-498e-9af6-37550eec6bd8 req-29ccce07-f321-4cf6-8a86-dcba22f14855 service nova] Enqueued Resource ID: 5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3 with Priority: HIGHEST for action port [ 926.181597] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_rules [ 926.181597] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 926.181597] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3 with Priority: HIGHEST for action port [ 926.184047] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.184201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.184270] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.184470] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.184568] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.185407] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.185570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.186062] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.186194] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.186259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.186416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.186495] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.653758] env[69343]: INFO networking_nsxv3.common.synchronization [req-efe1b935-10a2-4f75-9c58-66ba9d8b1e68 req-fe7aaeb7-ab88-4bae-bc41-41c4dcbf98bc tempest-InstanceActionsV221TestJSON-1758791130 tempest-InstanceActionsV221TestJSON-1758791130-project-member] Enqueued Resource ID: 0c195ad8-d052-4923-b668-42944e44042c with Priority: HIGHEST for action security_group_members [ 926.654357] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c195ad8-d052-4923-b668-42944e44042c with Priority: HIGHEST for action security_group_members [ 926.654670] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c195ad8-d052-4923-b668-42944e44042c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.654799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.654867] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.656586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.656586] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.656718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.656754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.658512] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.659130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.659130] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c195ad8-d052-4923-b668-42944e44042c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.688965] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.688965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.693021] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3 with status ACTIVE [ 926.693021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.693021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.693021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.693021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.693021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.693021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.693021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.693021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.693021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.693021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.693021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.693021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.693021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.693021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.693021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.693021] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3 is going to be updated. [ 926.716859] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.716859] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.716859] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.716859] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.716859] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.717090] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a0aa03a-cf16-4b7f-8202-2eebe2b7bfb3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.935179] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 926.935179] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b deletion is rescheduled due to dependency. [ 926.935624] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.935807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.936080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.936307] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.936389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.936457] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.936807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.936807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.936927] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.163946] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.164201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.164466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.164817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.164980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.165246] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.165406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.165507] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.165787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.165787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.165966] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c195ad8-d052-4923-b668-42944e44042c is going to be updated. [ 927.190935] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.191099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.191171] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.191373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.191513] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.201590] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c195ad8-d052-4923-b668-42944e44042c in Status: IN_PROGRESS for 2s [ 927.439592] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.942650] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.393196] env[69343]: INFO networking_nsxv3.common.synchronization [None req-587ac614-2f6e-4e1b-9166-3103dec4b8f9 None None] Enqueued Resource ID: 14f8c07b-a476-46d1-9544-bcb914238afc with Priority: HIGHEST for action port [ 928.396795] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14f8c07b-a476-46d1-9544-bcb914238afc with Priority: HIGHEST for action port [ 928.396795] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-14f8c07b-a476-46d1-9544-bcb914238afc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.396795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14f8c07b-a476-46d1-9544-bcb914238afc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.396795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14f8c07b-a476-46d1-9544-bcb914238afc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.396795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14f8c07b-a476-46d1-9544-bcb914238afc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.396795] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14f8c07b-a476-46d1-9544-bcb914238afc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.445195] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.445356] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.445427] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.445785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.445785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.445873] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 928.485971] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.486121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.486205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.486418] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.486567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.496463] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 928.897817] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14f8c07b-a476-46d1-9544-bcb914238afc [ 928.897817] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.897924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.897924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.898435] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.898584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.898714] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14f8c07b-a476-46d1-9544-bcb914238afc already deleted. [ 928.898824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14f8c07b-a476-46d1-9544-bcb914238afc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.045052] env[69343]: INFO networking_nsxv3.common.synchronization [req-60d0f979-3fa6-4d4c-bbdf-9a2f88d99dec req-d938fdad-ac0c-4dcc-8338-e98943fcb1a9 tempest-VolumesAdminNegativeTest-1863638197 tempest-VolumesAdminNegativeTest-1863638197-project-member] Enqueued Resource ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d with Priority: HIGHEST for action security_group_members [ 929.046213] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d with Priority: HIGHEST for action security_group_members [ 929.046213] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86385e4-9677-4817-aaf4-1d8d8e344e8d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.046213] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.046213] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.046765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.046765] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.046765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.046869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.047089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.047089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.047200] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86385e4-9677-4817-aaf4-1d8d8e344e8d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.215540] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c195ad8-d052-4923-b668-42944e44042c in Status: SUCCESS [ 929.215733] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c195ad8-d052-4923-b668-42944e44042c deletion is rescheduled due to dependency. [ 929.215892] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.550364] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.552876] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.553058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.553438] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.553438] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.553668] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.553779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.553848] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.554020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.554098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.554185] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d already deleted. [ 929.554267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.572553] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-375 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.572801] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-375" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.572938] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-375" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.573256] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-375" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.573536] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.573698] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.573820] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.575147] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.575888] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.575888] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 929.575888] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 929.575888] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 929.576101] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 929.578744] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 929.578744] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 929.578744] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 929.598797] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 929.598966] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 929.599123] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 929.599297] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-375" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.599639] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-29ed43ec-345d-4f80-80ed-0af782cfb09e taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.599829] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-29ed43ec-345d-4f80-80ed-0af782cfb09e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.601074] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-29ed43ec-345d-4f80-80ed-0af782cfb09e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.601074] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-29ed43ec-345d-4f80-80ed-0af782cfb09e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.601074] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29ed43ec-345d-4f80-80ed-0af782cfb09e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.750350] env[69343]: INFO networking_nsxv3.common.synchronization [None req-bdf76980-1b64-433b-9900-ceb3e3cac324 None None] Enqueued Resource ID: f911bcb2-8490-4da6-b4de-61ac14c612e5 with Priority: HIGHEST for action port [ 929.750892] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f911bcb2-8490-4da6-b4de-61ac14c612e5 with Priority: HIGHEST for action port [ 929.751203] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-f911bcb2-8490-4da6-b4de-61ac14c612e5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.751326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f911bcb2-8490-4da6-b4de-61ac14c612e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.751392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f911bcb2-8490-4da6-b4de-61ac14c612e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.754230] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f911bcb2-8490-4da6-b4de-61ac14c612e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.754344] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f911bcb2-8490-4da6-b4de-61ac14c612e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.104308] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.104570] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.104657] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.104944] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.105113] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.105280] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 29ed43ec-345d-4f80-80ed-0af782cfb09e not found, creating... [ 930.105552] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.105724] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.105839] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.106076] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.106216] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.106495] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.106667] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.108129] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.108129] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.108880] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.109933] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 29ed43ec-345d-4f80-80ed-0af782cfb09e is going to be created. [ 930.144660] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.144985] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.145182] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.145521] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.146903] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.146903] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-29ed43ec-345d-4f80-80ed-0af782cfb09e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.260605] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f911bcb2-8490-4da6-b4de-61ac14c612e5 [ 930.260605] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.260605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.260605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.260605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.260605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.260605] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f911bcb2-8490-4da6-b4de-61ac14c612e5 already deleted. [ 930.260605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f911bcb2-8490-4da6-b4de-61ac14c612e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.508914] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 930.509551] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.510024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.510301] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.510555] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.510716] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.510812] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.511038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.511134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.511265] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.511361] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.778153] env[69343]: INFO networking_nsxv3.common.synchronization [None req-c94aa14c-b526-4c0b-8383-92c0b1765e92 None None] Enqueued Resource ID: 0a8ae79d-3787-4e7a-aa6d-09e9a9b6ca79 with Priority: HIGHEST for action port [ 930.778636] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a8ae79d-3787-4e7a-aa6d-09e9a9b6ca79 with Priority: HIGHEST for action port [ 930.778943] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a8ae79d-3787-4e7a-aa6d-09e9a9b6ca79 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.783071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a8ae79d-3787-4e7a-aa6d-09e9a9b6ca79" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.783221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a8ae79d-3787-4e7a-aa6d-09e9a9b6ca79" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.783502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a8ae79d-3787-4e7a-aa6d-09e9a9b6ca79" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.783589] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a8ae79d-3787-4e7a-aa6d-09e9a9b6ca79',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.899606] env[69343]: INFO networking_nsxv3.common.synchronization [req-60d0f979-3fa6-4d4c-bbdf-9a2f88d99dec req-97eaa13d-3ca8-4182-9f06-6efd0bceea86 service nova] Enqueued Resource ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d with Priority: HIGHEST for action security_group_rules [ 930.900091] env[69343]: INFO networking_nsxv3.common.synchronization [req-60d0f979-3fa6-4d4c-bbdf-9a2f88d99dec req-97eaa13d-3ca8-4182-9f06-6efd0bceea86 service nova] Enqueued Resource ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d with Priority: HIGHEST for action security_group_members [ 930.905896] env[69343]: INFO networking_nsxv3.common.synchronization [req-60d0f979-3fa6-4d4c-bbdf-9a2f88d99dec req-97eaa13d-3ca8-4182-9f06-6efd0bceea86 service nova] Enqueued Resource ID: 29ed43ec-345d-4f80-80ed-0af782cfb09e with Priority: HIGHEST for action port [ 930.906406] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d with Priority: HIGHEST for action security_group_rules [ 930.906836] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d with Priority: HIGHEST for action security_group_members [ 930.910025] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29ed43ec-345d-4f80-80ed-0af782cfb09e with Priority: HIGHEST for action port [ 930.910025] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a86385e4-9677-4817-aaf4-1d8d8e344e8d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.910025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.910025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.910025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.910025] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a86385e4-9677-4817-aaf4-1d8d8e344e8d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.910025] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86385e4-9677-4817-aaf4-1d8d8e344e8d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.910418] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.910418] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.910929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.910929] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.911086] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.911122] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.911404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.911464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.911659] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86385e4-9677-4817-aaf4-1d8d8e344e8d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.912689] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-29ed43ec-345d-4f80-80ed-0af782cfb09e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.912816] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29ed43ec-345d-4f80-80ed-0af782cfb09e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.912888] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29ed43ec-345d-4f80-80ed-0af782cfb09e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.913106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29ed43ec-345d-4f80-80ed-0af782cfb09e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.913189] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29ed43ec-345d-4f80-80ed-0af782cfb09e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.014290] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.014460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.014522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.014767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.014943] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.015062] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.015129] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.015288] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.015376] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.015464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.015610] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.015705] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.015767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.015908] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.016065] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.016200] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.016284] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.016435] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.016515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.016621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.016723] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.286282] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a8ae79d-3787-4e7a-aa6d-09e9a9b6ca79 [ 931.286638] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.286845] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.286980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.287311] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.287483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.287654] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a8ae79d-3787-4e7a-aa6d-09e9a9b6ca79 already deleted. [ 931.287815] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a8ae79d-3787-4e7a-aa6d-09e9a9b6ca79" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.414917] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86385e4-9677-4817-aaf4-1d8d8e344e8d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.416464] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86385e4-9677-4817-aaf4-1d8d8e344e8d taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.416735] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.416953] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 29ed43ec-345d-4f80-80ed-0af782cfb09e with status ACTIVE [ 931.418066] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.418066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.418066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.418236] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.418266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.418437] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.418540] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.418603] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.418760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.418843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.419102] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.419226] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.419292] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.419596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.419596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.419713] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 29ed43ec-345d-4f80-80ed-0af782cfb09e is going to be updated. [ 931.441831] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.442012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.442055] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.442244] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.442383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.442541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29ed43ec-345d-4f80-80ed-0af782cfb09e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.479072] env[69343]: INFO networking_nsxv3.common.synchronization [None req-7274dea2-b181-47f0-9d37-f14c0bed2740 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 6aff3244-8376-4f32-8e71-5312a77febc9 with Priority: HIGHEST for action security_group_rules [ 931.479631] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aff3244-8376-4f32-8e71-5312a77febc9 with Priority: HIGHEST for action security_group_rules [ 931.480036] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6aff3244-8376-4f32-8e71-5312a77febc9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.480160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.480160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.480409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.480493] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6aff3244-8376-4f32-8e71-5312a77febc9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.520415] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47b39a17-6794-4f6b-b042-45a1e062090b: rpc.has_security_group_logging(os_id): False [ 931.543796] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.543796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.543796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.543796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.543796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.543796] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.543796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.543796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.543796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.543796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.543796] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.543796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.543796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.543796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.543796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.544369] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.544369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.544369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.544369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.544369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.544369] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 931.571858] env[69343]: INFO networking_nsxv3.common.synchronization [None req-e3718ba9-ce42-46c0-9d98-909fcc79973d tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 6aff3244-8376-4f32-8e71-5312a77febc9 with Priority: HIGHEST for action security_group_rules [ 931.572726] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aff3244-8376-4f32-8e71-5312a77febc9 with Priority: HIGHEST for action security_group_rules [ 931.573197] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6aff3244-8376-4f32-8e71-5312a77febc9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.573316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.627360] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.627513] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.627584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.628025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.628025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.659193] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 931.922331] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86385e4-9677-4817-aaf4-1d8d8e344e8d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.987954] env[69343]: INFO networking_nsxv3.common.synchronization [None req-edf4866e-7b86-4208-ae42-ac382f5a586f None None] Enqueued Resource ID: 3e33d645-6d36-4608-aedb-a645291f706f with Priority: HIGHEST for action port [ 931.987954] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e33d645-6d36-4608-aedb-a645291f706f with Priority: HIGHEST for action port [ 931.988699] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e33d645-6d36-4608-aedb-a645291f706f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.990399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e33d645-6d36-4608-aedb-a645291f706f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.992063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e33d645-6d36-4608-aedb-a645291f706f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.992063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e33d645-6d36-4608-aedb-a645291f706f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.992063] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e33d645-6d36-4608-aedb-a645291f706f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.001072] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.001072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.001072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.002721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.002721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.002721] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6aff3244-8376-4f32-8e71-5312a77febc9 already deleted. [ 932.002721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.003221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.003398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.003500] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6aff3244-8376-4f32-8e71-5312a77febc9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.429123] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.429123] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.429123] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.429123] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.429123] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.429123] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d is going to be created. [ 932.452823] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.452823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.452823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.452823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.452823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.462429] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d in Status: UNINITIALIZED for 2s [ 932.494930] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e33d645-6d36-4608-aedb-a645291f706f [ 932.496080] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.496080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.496080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.496287] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.499683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.499683] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e33d645-6d36-4608-aedb-a645291f706f already deleted. [ 932.499683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e33d645-6d36-4608-aedb-a645291f706f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.525625] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.525820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.525992] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.526153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.526266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.526393] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6aff3244-8376-4f32-8e71-5312a77febc9 already deleted. [ 932.526859] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.676628] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 933.676864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.475717] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d in Status: SUCCESS [ 934.476018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.476301] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.476562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.476917] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.477151] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.477225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.477399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.477488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.477581] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.477684] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a86385e4-9677-4817-aaf4-1d8d8e344e8d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.980686] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86385e4-9677-4817-aaf4-1d8d8e344e8d taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.981075] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.981075] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.981383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.981383] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.981682] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.981682] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.981759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.981837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.981923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.982083] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86385e4-9677-4817-aaf4-1d8d8e344e8d taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.982182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.982240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.982407] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.982523] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.982620] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.982673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.982812] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.982893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.982976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.983079] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a86385e4-9677-4817-aaf4-1d8d8e344e8d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.491035] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a86385e4-9677-4817-aaf4-1d8d8e344e8d: rpc.has_security_group_logging(os_id): False [ 935.510817] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.511029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.511125] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.511396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.511539] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.511897] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.512201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.512201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.512342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.512405] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.512557] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.512661] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.512720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.512985] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.513339] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.513699] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.513873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.514032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.514240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.514272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.514395] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d is going to be created. [ 935.588699] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.588699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.588699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.588699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.588699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.598678] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d in Status: IN_PROGRESS for 2s [ 936.503727] env[69343]: INFO networking_nsxv3.common.synchronization [None req-874f21f8-7030-46ce-98e0-36ee55241648 None None] Enqueued Resource ID: 9983444d-8f36-40ba-a7b8-2464617fee5c with Priority: HIGHEST for action port [ 936.504926] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9983444d-8f36-40ba-a7b8-2464617fee5c with Priority: HIGHEST for action port [ 936.506411] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-9983444d-8f36-40ba-a7b8-2464617fee5c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.507110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9983444d-8f36-40ba-a7b8-2464617fee5c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.507110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9983444d-8f36-40ba-a7b8-2464617fee5c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.507958] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9983444d-8f36-40ba-a7b8-2464617fee5c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.507958] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9983444d-8f36-40ba-a7b8-2464617fee5c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.013291] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9983444d-8f36-40ba-a7b8-2464617fee5c [ 937.013291] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.013291] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.013469] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.013789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.013894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.014000] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9983444d-8f36-40ba-a7b8-2464617fee5c already deleted. [ 937.014102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9983444d-8f36-40ba-a7b8-2464617fee5c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.611635] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d in Status: SUCCESS [ 937.612215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.152124] env[69343]: INFO networking_nsxv3.common.synchronization [req-0bec7d51-ce79-4f75-a5b6-0374a45a58dd req-ef0c764e-9ced-4138-a3ce-45473f809d92 tempest-ServerActionsTestJSON-1397784852 tempest-ServerActionsTestJSON-1397784852-project-member] Enqueued Resource ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 with Priority: HIGHEST for action security_group_members [ 941.152615] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 with Priority: HIGHEST for action security_group_members [ 941.152615] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.152615] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.152804] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.152979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.154461] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.154461] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.154461] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.154774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.154774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.154774] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.481046] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.481436] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-988" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.481611] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-988" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.482079] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-988" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.482416] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.482756] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.482970] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.483810] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.483810] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.483810] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.483964] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.484137] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.484309] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.484461] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.485028] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.485028] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.506875] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.507258] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 941.507472] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.507739] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-988" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.508155] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-558c5dd6-0831-4929-8cd1-654da81e057d taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.508397] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-558c5dd6-0831-4929-8cd1-654da81e057d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.508560] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-558c5dd6-0831-4929-8cd1-654da81e057d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.508974] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-558c5dd6-0831-4929-8cd1-654da81e057d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.509188] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('558c5dd6-0831-4929-8cd1-654da81e057d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.660016] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.660303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.660385] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.660602] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.660696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.661021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.661021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.661159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.661249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.661326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.661430] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 already deleted. [ 941.661553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.012259] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.012449] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.012547] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.014028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.014028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.014028] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 558c5dd6-0831-4929-8cd1-654da81e057d not found, creating... [ 942.014028] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.014028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.014028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.014028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.014410] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.014478] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.014641] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.014764] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.014998] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.015200] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.015388] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 558c5dd6-0831-4929-8cd1-654da81e057d is going to be created. [ 942.061539] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.061539] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.061539] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.061539] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.061539] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.061539] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-558c5dd6-0831-4929-8cd1-654da81e057d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.855501] env[69343]: INFO networking_nsxv3.common.synchronization [req-0bec7d51-ce79-4f75-a5b6-0374a45a58dd req-cd50a921-5800-473c-8549-fc534041f494 service nova] Enqueued Resource ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 with Priority: HIGHEST for action security_group_rules [ 942.855862] env[69343]: INFO networking_nsxv3.common.synchronization [req-0bec7d51-ce79-4f75-a5b6-0374a45a58dd req-cd50a921-5800-473c-8549-fc534041f494 service nova] Enqueued Resource ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 with Priority: HIGHEST for action security_group_members [ 942.855862] env[69343]: INFO networking_nsxv3.common.synchronization [req-0bec7d51-ce79-4f75-a5b6-0374a45a58dd req-cd50a921-5800-473c-8549-fc534041f494 service nova] Enqueued Resource ID: 558c5dd6-0831-4929-8cd1-654da81e057d with Priority: HIGHEST for action port [ 942.856175] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 with Priority: HIGHEST for action security_group_rules [ 942.856325] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 with Priority: HIGHEST for action security_group_members [ 942.856426] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 558c5dd6-0831-4929-8cd1-654da81e057d with Priority: HIGHEST for action port [ 942.857252] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.857465] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.857582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.857846] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.857964] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.859635] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.859833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.859970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.860267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.860996] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.860996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.860996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.860996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.860996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.860996] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.863169] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-558c5dd6-0831-4929-8cd1-654da81e057d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.863424] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-558c5dd6-0831-4929-8cd1-654da81e057d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.863540] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-558c5dd6-0831-4929-8cd1-654da81e057d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.863774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-558c5dd6-0831-4929-8cd1-654da81e057d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.863973] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('558c5dd6-0831-4929-8cd1-654da81e057d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.364285] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.365382] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.365580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.365852] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 558c5dd6-0831-4929-8cd1-654da81e057d with status ACTIVE [ 943.366027] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.366166] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.366238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.366407] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.366504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.366642] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.366772] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.366948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.366948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.367220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.367220] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.367292] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.367327] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.367466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.367554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.367625] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 558c5dd6-0831-4929-8cd1-654da81e057d is going to be updated. [ 943.393246] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.393393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.393455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.393660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.394249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.394249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-558c5dd6-0831-4929-8cd1-654da81e057d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.866882] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.370152] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.373382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.373382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.373382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.373382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.373382] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 is going to be created. [ 944.396732] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.396877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.396960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.397246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.397435] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.413025] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 in Status: UNINITIALIZED for 2s [ 944.546898] env[69343]: INFO networking_nsxv3.common.synchronization [req-f89c07a5-ae1d-4896-9c4a-ea6034628d92 req-b136f9a1-af7c-4357-b11c-205cd1c36e7e tempest-VolumesAdminNegativeTest-1863638197 tempest-VolumesAdminNegativeTest-1863638197-project-member] Enqueued Resource ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d with Priority: HIGHEST for action security_group_members [ 944.547558] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d with Priority: HIGHEST for action security_group_members [ 944.547881] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86385e4-9677-4817-aaf4-1d8d8e344e8d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.548024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.548674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.548900] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.549090] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.549198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.549262] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.549415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.549501] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.549596] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86385e4-9677-4817-aaf4-1d8d8e344e8d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.023099] env[69343]: INFO networking_nsxv3.common.synchronization [None req-847d6108-28f8-4895-bb53-6fa22130255f tempest-AttachVolumeTestJSON-1370042024 tempest-AttachVolumeTestJSON-1370042024-project-member] Enqueued Resource ID: 69f44a11-7085-48b3-ad36-634a77d99f4a with Priority: HIGHEST for action security_group_rules [ 945.023099] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f44a11-7085-48b3-ad36-634a77d99f4a with Priority: HIGHEST for action security_group_rules [ 945.023099] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f44a11-7085-48b3-ad36-634a77d99f4a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.023099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.023696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.024099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.024349] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f44a11-7085-48b3-ad36-634a77d99f4a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.054484] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.054484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.054484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.054484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.054484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.054484] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.054484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.054484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.054484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.054484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.054484] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d is going to be updated. [ 945.085887] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.086239] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.086347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.086634] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.086875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.097487] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d in Status: IN_PROGRESS for 2s [ 945.138223] env[69343]: INFO networking_nsxv3.common.synchronization [None req-5af3bc84-e0fd-4b4e-a0e7-36f5ebb824b6 tempest-AttachVolumeTestJSON-1370042024 tempest-AttachVolumeTestJSON-1370042024-project-member] Enqueued Resource ID: 69f44a11-7085-48b3-ad36-634a77d99f4a with Priority: HIGHEST for action security_group_rules [ 945.138855] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f44a11-7085-48b3-ad36-634a77d99f4a with Priority: HIGHEST for action security_group_rules [ 945.139196] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f44a11-7085-48b3-ad36-634a77d99f4a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.139300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.550073] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.550073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.550073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.550073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.550073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.550073] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f44a11-7085-48b3-ad36-634a77d99f4a already deleted. [ 945.550073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.550073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.550073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.550073] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f44a11-7085-48b3-ad36-634a77d99f4a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.789381] env[69343]: INFO networking_nsxv3.common.synchronization [req-3edef162-73bc-421a-9be1-a50cc72d17ed req-0aecbcd0-6739-494d-9f9a-e2a117ad1a22 tempest-ServersWithSpecificFlavorTestJSON-666360316 tempest-ServersWithSpecificFlavorTestJSON-666360316-project-member] Enqueued Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_members [ 945.789929] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGHEST for action security_group_members [ 945.790263] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f3ee775-00c0-4c70-a79b-23338c04f67f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.790398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.790467] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.790664] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.790820] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.790918] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.790979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.791570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.791570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.791570] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.073189] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.073189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.073189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.073650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.073650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.073650] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f44a11-7085-48b3-ad36-634a77d99f4a already deleted. [ 946.073650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.294312] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.295026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.295026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.295026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.295026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.295205] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.295302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.295358] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.295521] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.295599] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.295686] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f is going to be updated. [ 946.337485] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.337485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.337485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.338475] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.338475] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.349441] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f in Status: IN_PROGRESS for 2s [ 946.423115] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 in Status: SUCCESS [ 946.423343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.423582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.423815] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.424136] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.424136] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.424279] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.424361] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.424442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.424531] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.424621] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.931359] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.111093] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d in Status: SUCCESS [ 947.111343] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d deletion is rescheduled due to dependency. [ 947.111424] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.433946] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9: rpc.has_security_group_logging(os_id): False [ 947.454275] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.454362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.454434] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.454745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.454871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.455140] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.455254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.455322] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.455484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.455565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.455654] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 is going to be created. [ 947.522846] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.523433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.523433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.523433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.523433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.541624] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 in Status: IN_PROGRESS for 2s [ 947.772332] env[69343]: INFO networking_nsxv3.common.synchronization [req-f5b8cd8f-30db-4298-b7f0-2e0f42a05c25 req-ab40290a-51ba-4b01-9d41-54d25f9091d3 tempest-ImagesTestJSON-628353040 tempest-ImagesTestJSON-628353040-project-member] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 947.772332] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGHEST for action security_group_members [ 947.772332] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.772753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.772982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.773303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.773567] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.773782] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.773927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.774234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.774433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.774636] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.277061] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.277357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.277357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.277505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.277612] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.277810] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.277914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.277969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.278132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.278209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.278295] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be updated. [ 948.309948] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.309948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.310063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.310212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.310375] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.320468] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: IN_PROGRESS for 2s [ 948.379124] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f in Status: SUCCESS [ 948.379305] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f deletion is rescheduled due to dependency. [ 948.379507] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.247491] env[69343]: INFO networking_nsxv3.common.synchronization [req-0372fb01-a02b-4315-b548-55c8dbbed537 req-e7f499c5-e584-4322-a0b5-59c41ac48bcf tempest-ServerRescueTestJSONUnderV235-521676157 tempest-ServerRescueTestJSONUnderV235-521676157-project-member] Enqueued Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_members [ 949.247491] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_members [ 949.247491] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.247491] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.247491] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.247831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.248541] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.248541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.248541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.248541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.249133] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.249133] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.575050] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 in Status: SUCCESS [ 949.575050] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.595222] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.595466] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-706" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.595666] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-706" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.595920] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-706" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.596208] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.596373] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.596494] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.596721] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.596868] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.597101] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 949.597219] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 949.597332] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 949.597456] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 949.597573] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 949.597683] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 949.597833] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 949.624263] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 949.624438] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 949.624589] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 949.624778] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-706" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.625127] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.625312] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.625443] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.625791] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.625942] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63fd5e84-bcd1-4298-9316-0d8ead6f4ce3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.750785] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.750927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.751133] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.751254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.751362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.751605] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.751704] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.751836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.752017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.752101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.752190] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd already deleted. [ 949.752269] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.129046] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.129046] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.129046] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.129437] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.129437] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.129727] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 not found, creating... [ 950.129877] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.130066] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.130266] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.130485] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.130630] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.130949] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.131148] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.131345] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.131515] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.131667] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.131906] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 is going to be created. [ 950.153169] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.153169] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.153169] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.153482] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.153695] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.153927] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.344782] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47b39a17-6794-4f6b-b042-45a1e062090b in Status: SUCCESS [ 950.345146] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b deletion is rescheduled due to dependency. [ 950.345302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.862330] env[69343]: INFO networking_nsxv3.common.synchronization [req-0372fb01-a02b-4315-b548-55c8dbbed537 req-0b7c3af9-8f15-4430-8d5c-cade2ef0b25a service nova] Enqueued Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_rules [ 950.862639] env[69343]: INFO networking_nsxv3.common.synchronization [req-0372fb01-a02b-4315-b548-55c8dbbed537 req-0b7c3af9-8f15-4430-8d5c-cade2ef0b25a service nova] Enqueued Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_members [ 950.862734] env[69343]: INFO networking_nsxv3.common.synchronization [req-0372fb01-a02b-4315-b548-55c8dbbed537 req-0b7c3af9-8f15-4430-8d5c-cade2ef0b25a service nova] Enqueued Resource ID: 63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 with Priority: HIGHEST for action port [ 950.865409] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_rules [ 950.865409] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_members [ 950.865409] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 with Priority: HIGHEST for action port [ 950.865409] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.865409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.865806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.866069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.866252] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.868363] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.868611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.868735] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.868982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.869230] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.869635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.869635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.869917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.870079] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.870247] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.871424] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.871832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.871832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.875025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.875025] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63fd5e84-bcd1-4298-9316-0d8ead6f4ce3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.378026] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.378026] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.378026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.378026] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 with status ACTIVE [ 951.378026] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.378026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.378026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.378026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.378026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.378026] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.378026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.378026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.378839] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.379091] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.379493] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.379773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.379994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.380292] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.380849] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.381227] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 is going to be updated. [ 951.402657] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.402657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.402657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.402657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.402657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.402657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.723701] env[69343]: INFO networking_nsxv3.common.synchronization [req-788e5a6c-2979-4c35-aac2-8ab313ba512c req-b5e67afc-e12a-4620-8847-5c0fcff6ddd9 tempest-AttachVolumeNegativeTest-1961671669 tempest-AttachVolumeNegativeTest-1961671669-project-member] Enqueued Resource ID: 7532335d-79e6-454d-9693-a5b2f8a9923a with Priority: HIGHEST for action security_group_members [ 951.723701] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7532335d-79e6-454d-9693-a5b2f8a9923a with Priority: HIGHEST for action security_group_members [ 951.723779] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7532335d-79e6-454d-9693-a5b2f8a9923a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.723828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.723927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.724176] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.724332] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.724432] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.724494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.725066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.725066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.725066] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7532335d-79e6-454d-9693-a5b2f8a9923a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.877775] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.054708] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-837 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.055019] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-837" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.055194] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-837" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.055504] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-837" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.055822] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.056074] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.056237] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.056567] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.056766] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.057028] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 952.057238] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 952.057408] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 952.057554] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 952.057706] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 952.057882] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 952.058081] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 952.079967] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 952.080189] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 952.080341] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 952.080528] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-837" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.080869] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-22f6fe04-9274-4ac7-9049-fbbac4c5c9a2 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.081066] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-22f6fe04-9274-4ac7-9049-fbbac4c5c9a2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.081195] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-22f6fe04-9274-4ac7-9049-fbbac4c5c9a2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.081529] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-22f6fe04-9274-4ac7-9049-fbbac4c5c9a2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.081677] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22f6fe04-9274-4ac7-9049-fbbac4c5c9a2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.227287] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.227434] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.227472] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.227722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.227839] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.228074] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.228200] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.228282] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.228459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.228542] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.228640] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7532335d-79e6-454d-9693-a5b2f8a9923a already deleted. [ 952.228724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.380794] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.381047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.381047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.381417] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.381518] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.381626] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd is going to be created. [ 952.407753] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.408454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.408627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.408859] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.409044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.420114] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd in Status: UNINITIALIZED for 2s [ 952.584541] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.584753] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.584868] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.585289] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.585457] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.585638] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 22f6fe04-9274-4ac7-9049-fbbac4c5c9a2 not found, creating... [ 952.585941] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.586139] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.586266] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.586532] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.586680] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.586992] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.587262] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.587349] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.587550] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.587689] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.587833] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 22f6fe04-9274-4ac7-9049-fbbac4c5c9a2 is going to be created. [ 952.613458] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.613729] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.613894] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.614310] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.614610] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.614897] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-22f6fe04-9274-4ac7-9049-fbbac4c5c9a2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.318569] env[69343]: INFO networking_nsxv3.common.synchronization [req-788e5a6c-2979-4c35-aac2-8ab313ba512c req-e33200b6-8934-44ae-b62e-95f9538c09f3 service nova] Enqueued Resource ID: 7532335d-79e6-454d-9693-a5b2f8a9923a with Priority: HIGHEST for action security_group_rules [ 953.318793] env[69343]: INFO networking_nsxv3.common.synchronization [req-788e5a6c-2979-4c35-aac2-8ab313ba512c req-e33200b6-8934-44ae-b62e-95f9538c09f3 service nova] Enqueued Resource ID: 7532335d-79e6-454d-9693-a5b2f8a9923a with Priority: HIGHEST for action security_group_members [ 953.319013] env[69343]: INFO networking_nsxv3.common.synchronization [req-788e5a6c-2979-4c35-aac2-8ab313ba512c req-e33200b6-8934-44ae-b62e-95f9538c09f3 service nova] Enqueued Resource ID: 22f6fe04-9274-4ac7-9049-fbbac4c5c9a2 with Priority: HIGHEST for action port [ 953.319447] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7532335d-79e6-454d-9693-a5b2f8a9923a with Priority: HIGHEST for action security_group_rules [ 953.319582] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7532335d-79e6-454d-9693-a5b2f8a9923a with Priority: HIGHEST for action security_group_members [ 953.319681] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22f6fe04-9274-4ac7-9049-fbbac4c5c9a2 with Priority: HIGHEST for action port [ 953.319956] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7532335d-79e6-454d-9693-a5b2f8a9923a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.320095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.320179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.320356] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.320438] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7532335d-79e6-454d-9693-a5b2f8a9923a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.321290] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7532335d-79e6-454d-9693-a5b2f8a9923a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.321955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.321955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.321955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.321955] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.321955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.321955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.322258] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.322258] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.322311] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7532335d-79e6-454d-9693-a5b2f8a9923a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.323178] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-22f6fe04-9274-4ac7-9049-fbbac4c5c9a2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.323178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22f6fe04-9274-4ac7-9049-fbbac4c5c9a2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.323305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22f6fe04-9274-4ac7-9049-fbbac4c5c9a2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.323392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22f6fe04-9274-4ac7-9049-fbbac4c5c9a2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.323457] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22f6fe04-9274-4ac7-9049-fbbac4c5c9a2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.825252] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7532335d-79e6-454d-9693-a5b2f8a9923a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.825414] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.825639] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7532335d-79e6-454d-9693-a5b2f8a9923a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.826534] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22f6fe04-9274-4ac7-9049-fbbac4c5c9a2 with status ACTIVE [ 953.826724] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.826839] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.826907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.827127] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.827220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.827418] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.827533] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.827624] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.827789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.827871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.828068] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.828252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.828335] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.828851] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.828955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.829063] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22f6fe04-9274-4ac7-9049-fbbac4c5c9a2 is going to be updated. [ 953.852474] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.852671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.852716] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.852930] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.853088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.853247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22f6fe04-9274-4ac7-9049-fbbac4c5c9a2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.301842] env[69343]: INFO networking_nsxv3.common.synchronization [req-a4434740-4d55-42c8-b4aa-b5cd266fc5a6 req-314f020d-3c2f-470f-9de8-6a308cb43d79 tempest-ServerDiagnosticsNegativeTest-1652605748 tempest-ServerDiagnosticsNegativeTest-1652605748-project-member] Enqueued Resource ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 with Priority: HIGHEST for action security_group_members [ 954.302423] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 with Priority: HIGHEST for action security_group_members [ 954.309101] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-799bea39-1ae9-4b19-a079-d999ce5c8ff0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.313025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.313025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.313025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.313025] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.313025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.313025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.313025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.313025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.313025] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('799bea39-1ae9-4b19-a079-d999ce5c8ff0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.330709] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7532335d-79e6-454d-9693-a5b2f8a9923a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.432586] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd in Status: SUCCESS [ 954.432822] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.433016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.433249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.433444] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.433563] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.433628] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.433816] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.434069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.434069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.434147] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.653769] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.653995] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.655082] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.655428] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.655733] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.655908] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.656047] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.656290] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.656440] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.656652] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.656769] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.656881] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.656994] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.657122] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.657232] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.657368] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.678947] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.679131] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 954.679334] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.679525] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-887" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.679864] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-d2a15768-df6f-4207-90db-282122d17842 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.680136] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-d2a15768-df6f-4207-90db-282122d17842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.680297] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-d2a15768-df6f-4207-90db-282122d17842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.680747] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-d2a15768-df6f-4207-90db-282122d17842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.680908] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2a15768-df6f-4207-90db-282122d17842',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.813981] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.814170] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.814275] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.814515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.814616] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.814827] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.814939] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.815017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.815182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.815260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.815350] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 already deleted. [ 954.815457] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.833396] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.833396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.833396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.833396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.833396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.833631] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7532335d-79e6-454d-9693-a5b2f8a9923a is going to be created. [ 954.859703] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.859896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.859896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.860123] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.860290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.871507] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7532335d-79e6-454d-9693-a5b2f8a9923a in Status: UNINITIALIZED for 2s [ 954.938032] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.938032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.938032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.938032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.938032] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.938032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.938032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.938032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.938032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.938032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.938468] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.938468] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.938468] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.938468] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.938588] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.938588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.938648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.938806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.938852] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.938929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.939039] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.184086] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.184317] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.184497] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.184893] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.185335] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.185440] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port d2a15768-df6f-4207-90db-282122d17842 not found, creating... [ 955.185774] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.186024] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.186219] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.186563] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.186788] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.187243] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.187571] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.187760] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.188112] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.188352] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.188591] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: d2a15768-df6f-4207-90db-282122d17842 is going to be created. [ 955.213017] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.213275] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.213411] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.213768] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.214173] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.214533] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-d2a15768-df6f-4207-90db-282122d17842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.441490] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd: rpc.has_security_group_logging(os_id): False [ 955.464739] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.464958] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.464958] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.465193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.465284] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.465607] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.465607] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.465743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.465780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.465869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.466036] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.466135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.466196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.466337] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.466411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.466606] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.466698] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.466759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.466898] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.466974] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.467073] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd is going to be created. [ 955.552507] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.552734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.552734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.552985] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.553164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.572199] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd in Status: IN_PROGRESS for 2s [ 955.958979] env[69343]: INFO networking_nsxv3.common.synchronization [req-a4434740-4d55-42c8-b4aa-b5cd266fc5a6 req-82a1003c-45c2-4b7d-b624-5a0b39fa4451 service nova] Enqueued Resource ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 with Priority: HIGHEST for action security_group_rules [ 955.959189] env[69343]: INFO networking_nsxv3.common.synchronization [req-a4434740-4d55-42c8-b4aa-b5cd266fc5a6 req-82a1003c-45c2-4b7d-b624-5a0b39fa4451 service nova] Enqueued Resource ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 with Priority: HIGHEST for action security_group_members [ 955.959331] env[69343]: INFO networking_nsxv3.common.synchronization [req-a4434740-4d55-42c8-b4aa-b5cd266fc5a6 req-82a1003c-45c2-4b7d-b624-5a0b39fa4451 service nova] Enqueued Resource ID: d2a15768-df6f-4207-90db-282122d17842 with Priority: HIGHEST for action port [ 955.959564] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 with Priority: HIGHEST for action security_group_rules [ 955.959745] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 with Priority: HIGHEST for action security_group_members [ 955.959784] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2a15768-df6f-4207-90db-282122d17842 with Priority: HIGHEST for action port [ 955.960426] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-799bea39-1ae9-4b19-a079-d999ce5c8ff0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.960557] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.960631] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.960913] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.961021] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('799bea39-1ae9-4b19-a079-d999ce5c8ff0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.974044] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-799bea39-1ae9-4b19-a079-d999ce5c8ff0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.974044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.974044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.974044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.974044] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.974044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.974044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.974044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.974044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.974044] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('799bea39-1ae9-4b19-a079-d999ce5c8ff0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.975294] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2a15768-df6f-4207-90db-282122d17842 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.975294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2a15768-df6f-4207-90db-282122d17842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.975294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2a15768-df6f-4207-90db-282122d17842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.975560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2a15768-df6f-4207-90db-282122d17842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.975560] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2a15768-df6f-4207-90db-282122d17842',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.478075] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-799bea39-1ae9-4b19-a079-d999ce5c8ff0 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.478382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.478382] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('799bea39-1ae9-4b19-a079-d999ce5c8ff0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.479211] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2a15768-df6f-4207-90db-282122d17842 with status ACTIVE [ 956.479393] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.479506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.479573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.479826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.479928] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.480291] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.480291] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.480291] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.480547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.480547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.480674] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.480764] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.480825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.480965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.481299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.481436] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2a15768-df6f-4207-90db-282122d17842 is going to be updated. [ 956.507311] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.508313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.508855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.509788] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.510325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.510637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2a15768-df6f-4207-90db-282122d17842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.886104] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7532335d-79e6-454d-9693-a5b2f8a9923a in Status: SUCCESS [ 956.886255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.886570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.886570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.886991] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.886991] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.886991] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.887293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.887293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.887293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.887437] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7532335d-79e6-454d-9693-a5b2f8a9923a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.983941] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('799bea39-1ae9-4b19-a079-d999ce5c8ff0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.390540] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7532335d-79e6-454d-9693-a5b2f8a9923a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.487246] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.487246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.487246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.487246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.487246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.487914] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 is going to be created. [ 957.514041] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.514187] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.514276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.514490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.514646] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.527259] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 in Status: UNINITIALIZED for 2s [ 957.586090] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd in Status: SUCCESS [ 957.586420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.896669] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7532335d-79e6-454d-9693-a5b2f8a9923a: rpc.has_security_group_logging(os_id): False [ 957.917775] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.917775] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.917775] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.917775] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.918039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.918142] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.918219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.918291] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.918452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.919095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.919228] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7532335d-79e6-454d-9693-a5b2f8a9923a is going to be created. [ 958.012926] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.013214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.017023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.017023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.017023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.031630] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7532335d-79e6-454d-9693-a5b2f8a9923a in Status: IN_PROGRESS for 2s [ 958.781272] env[69343]: INFO networking_nsxv3.common.synchronization [None req-75a47217-ecc8-47ef-853e-e70ef63ee667 tempest-ServerDiskConfigTestJSON-1018188129 tempest-ServerDiskConfigTestJSON-1018188129-project-member] Enqueued Resource ID: 6b58cb98-a0d5-443e-9d21-36e0be221d71 with Priority: HIGHEST for action security_group_rules [ 958.782111] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b58cb98-a0d5-443e-9d21-36e0be221d71 with Priority: HIGHEST for action security_group_rules [ 958.782461] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b58cb98-a0d5-443e-9d21-36e0be221d71 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.782628] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b58cb98-a0d5-443e-9d21-36e0be221d71" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.782738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b58cb98-a0d5-443e-9d21-36e0be221d71" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.783118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b58cb98-a0d5-443e-9d21-36e0be221d71" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.783573] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b58cb98-a0d5-443e-9d21-36e0be221d71',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.870908] env[69343]: INFO networking_nsxv3.common.synchronization [None req-04cd95f4-3b3d-45ad-a4ea-1ebe91028f94 tempest-ServerDiskConfigTestJSON-1018188129 tempest-ServerDiskConfigTestJSON-1018188129-project-member] Enqueued Resource ID: 6b58cb98-a0d5-443e-9d21-36e0be221d71 with Priority: HIGHEST for action security_group_rules [ 958.871468] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b58cb98-a0d5-443e-9d21-36e0be221d71 with Priority: HIGHEST for action security_group_rules [ 958.871791] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b58cb98-a0d5-443e-9d21-36e0be221d71 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.871922] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b58cb98-a0d5-443e-9d21-36e0be221d71" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.310946] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.311143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.311252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.311529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.311645] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.311759] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b58cb98-a0d5-443e-9d21-36e0be221d71 already deleted. [ 959.311909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b58cb98-a0d5-443e-9d21-36e0be221d71" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.312089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b58cb98-a0d5-443e-9d21-36e0be221d71" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.312296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b58cb98-a0d5-443e-9d21-36e0be221d71" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.312381] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b58cb98-a0d5-443e-9d21-36e0be221d71',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.538862] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 in Status: SUCCESS [ 959.539629] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.539629] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.539629] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.539905] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.540104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.540235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.540451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.540578] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.540718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.540850] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('799bea39-1ae9-4b19-a079-d999ce5c8ff0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.836255] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.836621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.836621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.836959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.836959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.836959] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b58cb98-a0d5-443e-9d21-36e0be221d71 already deleted. [ 959.836959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b58cb98-a0d5-443e-9d21-36e0be221d71" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.046029] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7532335d-79e6-454d-9693-a5b2f8a9923a in Status: SUCCESS [ 960.046029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.046029] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-799bea39-1ae9-4b19-a079-d999ce5c8ff0 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.046029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.046029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.046029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.046029] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.046029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.046029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.046029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.046029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.046029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.046029] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-799bea39-1ae9-4b19-a079-d999ce5c8ff0 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.046029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.046029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.046029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.046900] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.047179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.047413] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.047736] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.047995] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.048303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.048774] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('799bea39-1ae9-4b19-a079-d999ce5c8ff0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.551689] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 799bea39-1ae9-4b19-a079-d999ce5c8ff0: rpc.has_security_group_logging(os_id): False [ 960.575882] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.575882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.575882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.576182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.576329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.576557] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.576656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.576720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.576889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.578043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.578043] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.578043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.578043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.578043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.578043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.578043] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.578043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.578043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.578430] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.578430] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.578430] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 is going to be created. [ 960.668668] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.668668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.668668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.668668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.668668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.688715] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 in Status: IN_PROGRESS for 2s [ 962.632414] env[69343]: INFO networking_nsxv3.common.synchronization [req-8ab54697-e94f-4996-9798-7621d9c9e06c req-998e2d34-7a95-40c1-be8d-2a67ea1ef444 tempest-ServerDiskConfigTestJSON-1018188129 tempest-ServerDiskConfigTestJSON-1018188129-project-member] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 962.633516] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 962.634132] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.634132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.634132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.634446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.634446] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.634583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.634583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.634742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.635076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.635076] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.706306] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 in Status: SUCCESS [ 962.706839] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.142066] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.142066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.142066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.142066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.142066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.142066] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.142066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.142066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.142066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.142066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.142066] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 963.179179] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.179179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.179179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.179179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.179179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.191894] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 963.260803] env[69343]: INFO networking_nsxv3.common.synchronization [req-e7af6893-026c-46f9-ad11-7c7935262339 req-dd340358-7630-42be-9213-4e6f13ce6c94 tempest-FloatingIPsAssociationTestJSON-927978617 tempest-FloatingIPsAssociationTestJSON-927978617-project-member] Enqueued Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGHEST for action security_group_members [ 963.261442] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGHEST for action security_group_members [ 963.261795] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.261960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.262037] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.262322] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.262490] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.262624] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.262683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.262817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.262950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.263585] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.682106] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-9 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.682569] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.682569] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.682864] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.683369] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.683607] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.683745] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.684056] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.684288] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.684570] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 963.684743] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 963.684867] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 963.684987] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 963.685273] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 963.685403] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 963.685553] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 963.712758] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 963.713559] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 963.713559] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 963.713559] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.713781] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-c8d33d30-ceca-4418-ac8f-81ad319eda1a taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.713859] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-c8d33d30-ceca-4418-ac8f-81ad319eda1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.713907] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-c8d33d30-ceca-4418-ac8f-81ad319eda1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.714271] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-c8d33d30-ceca-4418-ac8f-81ad319eda1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.714428] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8d33d30-ceca-4418-ac8f-81ad319eda1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.765458] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.765606] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.765681] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.765898] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.765993] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.766241] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.766377] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.766377] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.766549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.766619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.766686] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e already deleted. [ 963.766740] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.218101] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.218398] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.218641] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.219109] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.219256] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.219458] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port c8d33d30-ceca-4418-ac8f-81ad319eda1a not found, creating... [ 964.219758] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.219924] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.220062] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.220308] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.220453] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.220750] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.220912] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.221056] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.221319] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.221493] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.221644] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: c8d33d30-ceca-4418-ac8f-81ad319eda1a is going to be created. [ 964.244122] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.244365] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.244496] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.244792] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.245125] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.245291] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-c8d33d30-ceca-4418-ac8f-81ad319eda1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.959675] env[69343]: INFO networking_nsxv3.common.synchronization [req-e7af6893-026c-46f9-ad11-7c7935262339 req-b61e3db1-7aab-41ba-9f97-53db7eea7601 service nova] Enqueued Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGHEST for action security_group_rules [ 964.960073] env[69343]: INFO networking_nsxv3.common.synchronization [req-e7af6893-026c-46f9-ad11-7c7935262339 req-b61e3db1-7aab-41ba-9f97-53db7eea7601 service nova] Enqueued Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGHEST for action security_group_members [ 964.960073] env[69343]: INFO networking_nsxv3.common.synchronization [req-e7af6893-026c-46f9-ad11-7c7935262339 req-b61e3db1-7aab-41ba-9f97-53db7eea7601 service nova] Enqueued Resource ID: c8d33d30-ceca-4418-ac8f-81ad319eda1a with Priority: HIGHEST for action port [ 964.960251] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGHEST for action security_group_rules [ 964.960373] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGHEST for action security_group_members [ 964.960475] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8d33d30-ceca-4418-ac8f-81ad319eda1a with Priority: HIGHEST for action port [ 964.961095] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.961287] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.961438] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.961668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.961775] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.963025] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.963231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.963316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.963575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.963766] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.963931] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.963983] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.964211] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.964499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.964668] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.965558] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8d33d30-ceca-4418-ac8f-81ad319eda1a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.965659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8d33d30-ceca-4418-ac8f-81ad319eda1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.965728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8d33d30-ceca-4418-ac8f-81ad319eda1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.966021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8d33d30-ceca-4418-ac8f-81ad319eda1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.966175] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8d33d30-ceca-4418-ac8f-81ad319eda1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.204128] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 965.204435] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b deletion is rescheduled due to dependency. [ 965.204604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.468405] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.468635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.468733] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.469693] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8d33d30-ceca-4418-ac8f-81ad319eda1a with status ACTIVE [ 965.469913] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.470049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.470119] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.470323] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.470413] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.470586] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.470683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.470743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.470908] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.474030] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.474462] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.474571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.474637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.474949] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.475104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.475243] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8d33d30-ceca-4418-ac8f-81ad319eda1a is going to be updated. [ 965.500321] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.500575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.500674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.500938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.501136] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.502029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8d33d30-ceca-4418-ac8f-81ad319eda1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.715258] env[69343]: INFO networking_nsxv3.common.synchronization [req-d29cf27a-ed13-4fc7-829a-27fa8a686337 req-1fddeb33-c23e-49c8-934f-c38c5786ec86 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 6aff3244-8376-4f32-8e71-5312a77febc9 with Priority: HIGHEST for action security_group_members [ 965.715258] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aff3244-8376-4f32-8e71-5312a77febc9 with Priority: HIGHEST for action security_group_members [ 965.716053] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6aff3244-8376-4f32-8e71-5312a77febc9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.716430] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.716650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.717048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.717337] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.718635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.718635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.718635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.718635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.718635] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6aff3244-8376-4f32-8e71-5312a77febc9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.978264] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.129565] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.129793] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.130105] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.130343] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.130633] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.130799] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.130921] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.131188] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.131341] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.131551] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.131670] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.131792] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.131953] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.132041] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.132156] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.132295] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.159024] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.159024] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 966.159024] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.159024] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.159024] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-5aca73a8-8330-4080-a971-a9816f5db8b9 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.159024] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-5aca73a8-8330-4080-a971-a9816f5db8b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.159024] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-5aca73a8-8330-4080-a971-a9816f5db8b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.159024] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-5aca73a8-8330-4080-a971-a9816f5db8b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.159024] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aca73a8-8330-4080-a971-a9816f5db8b9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.220744] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.220823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.220858] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.221130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.221230] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.221556] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.221614] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.221725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.221864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.222115] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.222115] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6aff3244-8376-4f32-8e71-5312a77febc9 already deleted. [ 966.222193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.481058] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.481230] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.481302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.481516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.481610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.481706] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e is going to be created. [ 966.513691] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.513859] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.513906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.514319] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.514464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.526100] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e in Status: UNINITIALIZED for 2s [ 966.661920] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.662227] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.662380] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.662681] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.662882] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.663110] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 5aca73a8-8330-4080-a971-a9816f5db8b9 not found, creating... [ 966.663413] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.663581] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.663705] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.663947] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.664112] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.664442] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.664616] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.664740] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.664958] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.665115] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.665261] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 5aca73a8-8330-4080-a971-a9816f5db8b9 is going to be created. [ 966.707259] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.707443] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.707562] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.707962] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.708238] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.708444] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-5aca73a8-8330-4080-a971-a9816f5db8b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.505087] env[69343]: INFO networking_nsxv3.common.synchronization [req-d29cf27a-ed13-4fc7-829a-27fa8a686337 req-afb0e14a-6707-4c30-b30e-a8b0b5dd47fa service nova] Enqueued Resource ID: 6aff3244-8376-4f32-8e71-5312a77febc9 with Priority: HIGHEST for action security_group_rules [ 967.505087] env[69343]: INFO networking_nsxv3.common.synchronization [req-d29cf27a-ed13-4fc7-829a-27fa8a686337 req-afb0e14a-6707-4c30-b30e-a8b0b5dd47fa service nova] Enqueued Resource ID: 6aff3244-8376-4f32-8e71-5312a77febc9 with Priority: HIGHEST for action security_group_members [ 967.505087] env[69343]: INFO networking_nsxv3.common.synchronization [req-d29cf27a-ed13-4fc7-829a-27fa8a686337 req-afb0e14a-6707-4c30-b30e-a8b0b5dd47fa service nova] Enqueued Resource ID: 5aca73a8-8330-4080-a971-a9816f5db8b9 with Priority: HIGHEST for action port [ 967.505087] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aff3244-8376-4f32-8e71-5312a77febc9 with Priority: HIGHEST for action security_group_rules [ 967.505087] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aff3244-8376-4f32-8e71-5312a77febc9 with Priority: HIGHEST for action security_group_members [ 967.505087] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aca73a8-8330-4080-a971-a9816f5db8b9 with Priority: HIGHEST for action port [ 967.505087] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6aff3244-8376-4f32-8e71-5312a77febc9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.505087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.505966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.506332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.506560] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6aff3244-8376-4f32-8e71-5312a77febc9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.510640] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6aff3244-8376-4f32-8e71-5312a77febc9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.510640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.510640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.510640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.510640] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.510640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.510640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.510640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.510640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.510640] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6aff3244-8376-4f32-8e71-5312a77febc9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.516107] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-5aca73a8-8330-4080-a971-a9816f5db8b9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.516107] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5aca73a8-8330-4080-a971-a9816f5db8b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.516107] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5aca73a8-8330-4080-a971-a9816f5db8b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.516107] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5aca73a8-8330-4080-a971-a9816f5db8b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.516107] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aca73a8-8330-4080-a971-a9816f5db8b9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.010569] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6aff3244-8376-4f32-8e71-5312a77febc9 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.010775] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.014362] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6aff3244-8376-4f32-8e71-5312a77febc9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.015931] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5aca73a8-8330-4080-a971-a9816f5db8b9 with status ACTIVE [ 968.016054] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.016125] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.016259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.016500] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.016625] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.016866] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.017010] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.017109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.017320] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.017426] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.017678] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.017812] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.017901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.018117] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.018223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.018342] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5aca73a8-8330-4080-a971-a9816f5db8b9 is going to be updated. [ 968.042467] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.042696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.042769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.043049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.043226] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.043441] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5aca73a8-8330-4080-a971-a9816f5db8b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.185527] env[69343]: INFO networking_nsxv3.common.synchronization [req-8468fdac-7ecd-42d6-a9bc-732fb9522c1b req-c5312198-9ba0-451a-93ba-d271b5e2d627 tempest-ServersTestJSON-245111932 tempest-ServersTestJSON-245111932-project-member] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 968.186115] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 968.186437] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.186568] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.186633] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.186819] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.186974] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.187082] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.187142] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.187295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.187400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.187536] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.521716] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6aff3244-8376-4f32-8e71-5312a77febc9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.538032] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e in Status: SUCCESS [ 968.538032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.538032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.538032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.538032] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.538032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.538032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.538032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.538032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.538032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.538032] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.640342] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.640560] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.640690] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.640988] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.641297] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.641467] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.641591] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.641830] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.642016] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.644457] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 968.644457] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.644615] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.644790] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.644967] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 968.645170] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.645488] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.665768] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.666036] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 968.668176] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.668476] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.668886] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-8c6c10d4-ca66-419f-a92d-2c04444ede23 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.671167] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-8c6c10d4-ca66-419f-a92d-2c04444ede23" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.671330] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-8c6c10d4-ca66-419f-a92d-2c04444ede23" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.671751] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-8c6c10d4-ca66-419f-a92d-2c04444ede23" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.672019] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c6c10d4-ca66-419f-a92d-2c04444ede23',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.689505] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.813200] env[69343]: INFO networking_nsxv3.common.synchronization [req-8a8dcbcf-ab77-4578-8e0e-64c8cb5acd2e req-eab86d7e-d5c8-4b88-8409-c8d322f65587 tempest-ServerDiagnosticsNegativeTest-1652605748 tempest-ServerDiagnosticsNegativeTest-1652605748-project-member] Enqueued Resource ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 with Priority: HIGHEST for action security_group_members [ 968.813200] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 with Priority: HIGHEST for action security_group_members [ 968.813200] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-799bea39-1ae9-4b19-a079-d999ce5c8ff0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.813200] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.813200] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.813200] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.814173] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.814514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.814728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.815042] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.815274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.815761] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('799bea39-1ae9-4b19-a079-d999ce5c8ff0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.026141] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.026141] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.026141] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.026141] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.026141] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.026141] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6aff3244-8376-4f32-8e71-5312a77febc9 is going to be created. [ 969.040557] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.040700] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.040742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.042036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.042036] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.042036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.042036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.042036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.042036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.042036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.042036] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.042036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.042036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.042455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.042455] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.042455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.042455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.042659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.042659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.042750] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.042808] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.051086] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.051230] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.051281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.051480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.051638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.062904] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6aff3244-8376-4f32-8e71-5312a77febc9 in Status: UNINITIALIZED for 2s [ 969.176563] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.176904] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.177168] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.177498] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.177658] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.177823] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 8c6c10d4-ca66-419f-a92d-2c04444ede23 not found, creating... [ 969.178217] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.178782] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.178782] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.178782] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.178951] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.179279] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.179452] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.179638] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.180018] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.180231] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.180401] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 8c6c10d4-ca66-419f-a92d-2c04444ede23 is going to be created. [ 969.192997] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.204603] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.204808] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.204944] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.205341] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.205587] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.205829] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-8c6c10d4-ca66-419f-a92d-2c04444ede23" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.322040] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.322319] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.322422] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.322683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.322927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.323064] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.323205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.323277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.324506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.324506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.324506] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 is going to be updated. [ 969.373201] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.373657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.373844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.374215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.374543] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.390326] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 in Status: IN_PROGRESS for 2s [ 969.438177] env[69343]: INFO networking_nsxv3.common.synchronization [req-08100bd2-80a3-44c0-96f8-8e46ae8d33bb req-1924b223-210b-45f8-9d18-b4da3f912cdc tempest-ServerRescueTestJSONUnderV235-521676157 tempest-ServerRescueTestJSONUnderV235-521676157-project-member] Enqueued Resource ID: 413f66d2-4c29-4e75-be43-518af1022160 with Priority: HIGHEST for action security_group_members [ 969.438177] env[69343]: INFO networking_nsxv3.common.synchronization [req-08100bd2-80a3-44c0-96f8-8e46ae8d33bb req-1924b223-210b-45f8-9d18-b4da3f912cdc tempest-ServerRescueTestJSONUnderV235-521676157 tempest-ServerRescueTestJSONUnderV235-521676157-project-member] Enqueued Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_members [ 969.438177] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413f66d2-4c29-4e75-be43-518af1022160 with Priority: HIGHEST for action security_group_members [ 969.438177] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_members [ 969.440235] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-413f66d2-4c29-4e75-be43-518af1022160 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.440235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.440235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.440235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.440235] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.440235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.440235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.440235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.440235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.440235] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('413f66d2-4c29-4e75-be43-518af1022160',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.440853] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.442307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.442307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.442307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.442307] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.442307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.442307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.442307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.442307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.442307] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.533572] env[69343]: INFO networking_nsxv3.common.synchronization [req-08100bd2-80a3-44c0-96f8-8e46ae8d33bb req-1924b223-210b-45f8-9d18-b4da3f912cdc tempest-ServerRescueTestJSONUnderV235-521676157 tempest-ServerRescueTestJSONUnderV235-521676157-project-member] Enqueued Resource ID: 413f66d2-4c29-4e75-be43-518af1022160 with Priority: HIGHEST for action security_group_rules [ 969.533572] env[69343]: INFO networking_nsxv3.common.synchronization [req-08100bd2-80a3-44c0-96f8-8e46ae8d33bb req-1924b223-210b-45f8-9d18-b4da3f912cdc tempest-ServerRescueTestJSONUnderV235-521676157 tempest-ServerRescueTestJSONUnderV235-521676157-project-member] Enqueued Resource ID: 413f66d2-4c29-4e75-be43-518af1022160 with Priority: HIGHEST for action security_group_members [ 969.533572] env[69343]: INFO networking_nsxv3.common.synchronization [req-08100bd2-80a3-44c0-96f8-8e46ae8d33bb req-1924b223-210b-45f8-9d18-b4da3f912cdc tempest-ServerRescueTestJSONUnderV235-521676157 tempest-ServerRescueTestJSONUnderV235-521676157-project-member] Enqueued Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_rules [ 969.533572] env[69343]: INFO networking_nsxv3.common.synchronization [req-08100bd2-80a3-44c0-96f8-8e46ae8d33bb req-1924b223-210b-45f8-9d18-b4da3f912cdc tempest-ServerRescueTestJSONUnderV235-521676157 tempest-ServerRescueTestJSONUnderV235-521676157-project-member] Enqueued Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_members [ 969.533572] env[69343]: INFO networking_nsxv3.common.synchronization [req-08100bd2-80a3-44c0-96f8-8e46ae8d33bb req-1924b223-210b-45f8-9d18-b4da3f912cdc tempest-ServerRescueTestJSONUnderV235-521676157 tempest-ServerRescueTestJSONUnderV235-521676157-project-member] Enqueued Resource ID: 63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 with Priority: HIGHEST for action port [ 969.535669] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413f66d2-4c29-4e75-be43-518af1022160 with Priority: HIGHEST for action security_group_rules [ 969.536234] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_rules [ 969.536780] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 with Priority: HIGHEST for action port [ 969.538158] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413f66d2-4c29-4e75-be43-518af1022160 with Priority: HIGHEST for action security_group_members [ 969.539358] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_members [ 969.540679] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-413f66d2-4c29-4e75-be43-518af1022160 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.540679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.540858] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.541497] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.541602] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('413f66d2-4c29-4e75-be43-518af1022160',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.544284] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.544284] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.544461] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.544539] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.544647] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.546589] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.546731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.546799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.547011] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.547101] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63fd5e84-bcd1-4298-9316-0d8ead6f4ce3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.548390] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-413f66d2-4c29-4e75-be43-518af1022160 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.548538] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.548795] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.548951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.550168] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e: rpc.has_security_group_logging(os_id): False [ 969.574698] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.574849] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.574891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.575160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.575268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.575479] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.575582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.575646] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.575803] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.575882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.576076] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.576164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.576225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.576368] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.576439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.576622] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.576711] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.576767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.576907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.577030] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.577419] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e is going to be created. [ 969.659275] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.659502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.659594] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.659843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.660156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.680175] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e in Status: IN_PROGRESS for 2s [ 969.696163] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.696397] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.696440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.696700] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.696826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.696963] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 969.745319] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.745560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.745560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.745738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.745968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.762953] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 969.944017] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('413f66d2-4c29-4e75-be43-518af1022160',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.945397] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.045318] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-413f66d2-4c29-4e75-be43-518af1022160 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.045557] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.052513] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 with status ACTIVE [ 970.052734] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.052872] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.052973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.053212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.053304] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.053485] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.053585] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.053642] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.053791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.053868] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.054053] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.054142] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.054469] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.054469] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.054469] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.054469] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 is going to be updated. [ 970.055709] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.055828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.078024] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.078285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.078285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.078470] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.078600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.078878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.401668] env[69343]: INFO networking_nsxv3.common.synchronization [req-c10d5f2f-5f27-438b-9ea1-074c7fd6376f req-424a605c-58f8-4d12-a403-5b2d82d40789 tempest-ServerRescueTestJSONUnderV235-521676157 tempest-ServerRescueTestJSONUnderV235-521676157-project-member] Enqueued Resource ID: 413f66d2-4c29-4e75-be43-518af1022160 with Priority: HIGHEST for action security_group_members [ 970.401905] env[69343]: INFO networking_nsxv3.common.synchronization [req-c10d5f2f-5f27-438b-9ea1-074c7fd6376f req-424a605c-58f8-4d12-a403-5b2d82d40789 tempest-ServerRescueTestJSONUnderV235-521676157 tempest-ServerRescueTestJSONUnderV235-521676157-project-member] Enqueued Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_members [ 970.403231] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413f66d2-4c29-4e75-be43-518af1022160 with Priority: HIGHEST for action security_group_members [ 970.403317] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_members [ 970.403661] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-413f66d2-4c29-4e75-be43-518af1022160 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.403865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.404079] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.404204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.448661] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.454310] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('413f66d2-4c29-4e75-be43-518af1022160',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.563240] env[69343]: INFO networking_nsxv3.common.synchronization [req-c10d5f2f-5f27-438b-9ea1-074c7fd6376f req-424a605c-58f8-4d12-a403-5b2d82d40789 tempest-ServerRescueTestJSONUnderV235-521676157 tempest-ServerRescueTestJSONUnderV235-521676157-project-member] Enqueued Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_rules [ 970.563240] env[69343]: INFO networking_nsxv3.common.synchronization [req-c10d5f2f-5f27-438b-9ea1-074c7fd6376f req-424a605c-58f8-4d12-a403-5b2d82d40789 tempest-ServerRescueTestJSONUnderV235-521676157 tempest-ServerRescueTestJSONUnderV235-521676157-project-member] Enqueued Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_members [ 970.563240] env[69343]: INFO networking_nsxv3.common.synchronization [req-c10d5f2f-5f27-438b-9ea1-074c7fd6376f req-424a605c-58f8-4d12-a403-5b2d82d40789 tempest-ServerRescueTestJSONUnderV235-521676157 tempest-ServerRescueTestJSONUnderV235-521676157-project-member] Enqueued Resource ID: 63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 with Priority: HIGHEST for action port [ 970.569179] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_rules [ 970.569179] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_members [ 970.569179] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 with Priority: HIGHEST for action port [ 970.569576] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.569576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.573026] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.573026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.573026] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.573026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.573026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.573026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.573026] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63fd5e84-bcd1-4298-9316-0d8ead6f4ce3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.593573] env[69343]: INFO networking_nsxv3.common.synchronization [req-8468fdac-7ecd-42d6-a9bc-732fb9522c1b req-f795ece9-0ad0-4177-b801-baf047a69410 service nova] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_rules [ 970.593573] env[69343]: INFO networking_nsxv3.common.synchronization [req-8468fdac-7ecd-42d6-a9bc-732fb9522c1b req-f795ece9-0ad0-4177-b801-baf047a69410 service nova] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 970.593573] env[69343]: INFO networking_nsxv3.common.synchronization [req-8468fdac-7ecd-42d6-a9bc-732fb9522c1b req-f795ece9-0ad0-4177-b801-baf047a69410 service nova] Enqueued Resource ID: 8c6c10d4-ca66-419f-a92d-2c04444ede23 with Priority: HIGHEST for action port [ 970.594096] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_rules [ 970.594635] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 970.594766] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6c10d4-ca66-419f-a92d-2c04444ede23 with Priority: HIGHEST for action port [ 970.595072] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.595273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.595273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.595740] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.595740] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.598028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.598028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.598028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c6c10d4-ca66-419f-a92d-2c04444ede23 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.598028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c6c10d4-ca66-419f-a92d-2c04444ede23" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.598028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c6c10d4-ca66-419f-a92d-2c04444ede23" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.598028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c6c10d4-ca66-419f-a92d-2c04444ede23" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.598028] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c6c10d4-ca66-419f-a92d-2c04444ede23',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.816136] env[69343]: INFO networking_nsxv3.common.synchronization [req-e49ec6a0-d949-417e-98ca-34c9c1ae8942 req-b39daeb7-79f9-4de2-8974-66e25ed9b5ae tempest-ServerActionsTestOtherB-1339566970 tempest-ServerActionsTestOtherB-1339566970-project-member] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 970.816136] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 970.816136] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.816136] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.816136] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.817262] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.817582] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.817833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.818357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.820187] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.820187] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.820187] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.955385] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.955749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.955749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.955978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.956120] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.956337] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd is going to be updated. [ 970.960454] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.963069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.963069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.963069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.963069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.963069] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 413f66d2-4c29-4e75-be43-518af1022160 is going to be created. [ 971.010268] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.010426] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.010426] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.010670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.010875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.022330] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.022615] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.022615] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.024154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.024154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.039708] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd in Status: IN_PROGRESS for 2s [ 971.041317] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413f66d2-4c29-4e75-be43-518af1022160 in Status: UNINITIALIZED for 2s [ 971.073651] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 with status ACTIVE [ 971.074097] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.074274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.074371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.074536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.074663] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.074854] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.074951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.075021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.075206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.075276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.075462] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.075569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.075631] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.075766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.075842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.076149] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63fd5e84-bcd1-4298-9316-0d8ead6f4ce3 is going to be updated. [ 971.080046] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6aff3244-8376-4f32-8e71-5312a77febc9 in Status: SUCCESS [ 971.080174] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.080617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.080820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.081019] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.081403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.081403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.081403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.081564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.081564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.081623] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6aff3244-8376-4f32-8e71-5312a77febc9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.099381] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.099556] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.099946] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c6c10d4-ca66-419f-a92d-2c04444ede23 with status ACTIVE [ 971.100068] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.100712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.100712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.100712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.100712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.100712] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.101195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.101195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.101195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.101195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.101397] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.101397] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.101397] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.101594] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.101659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.101751] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c6c10d4-ca66-419f-a92d-2c04444ede23 is going to be updated. [ 971.126561] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.126561] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.126561] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.126561] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.126561] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.126561] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63fd5e84-bcd1-4298-9316-0d8ead6f4ce3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.152034] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.152034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.152034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.152034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.152034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.152034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c6c10d4-ca66-419f-a92d-2c04444ede23" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.202124] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-551 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.202124] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-551" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.202124] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-551" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.202124] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-551" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.202862] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.203325] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.203712] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.204140] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.207058] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.207058] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 971.207058] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.207058] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.207058] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.207058] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 971.207058] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.207058] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.282038] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.282038] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.075 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 971.282038] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.282038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-551" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.282038] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-3951dca7-fe43-456b-96a4-045e3518d5cb taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.282038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-3951dca7-fe43-456b-96a4-045e3518d5cb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.282038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-3951dca7-fe43-456b-96a4-045e3518d5cb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.282812] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-3951dca7-fe43-456b-96a4-045e3518d5cb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.283181] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3951dca7-fe43-456b-96a4-045e3518d5cb',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.325250] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.325250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.325250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.325250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.325250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.325250] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.325250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.325250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.325250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.325250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.325250] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 is going to be updated. [ 971.375289] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.375289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.375289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.375289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.375289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.384144] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: IN_PROGRESS for 2s [ 971.404684] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 in Status: SUCCESS [ 971.404684] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 deletion is rescheduled due to dependency. [ 971.404684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.584989] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6aff3244-8376-4f32-8e71-5312a77febc9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.708608] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e in Status: SUCCESS [ 971.708887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.777466] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 971.777466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.777466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.777466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.777466] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.777466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.777466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.778154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.778154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.778154] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.789025] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.789025] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.789025] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.789025] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.789025] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.789025] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 3951dca7-fe43-456b-96a4-045e3518d5cb not found, creating... [ 971.789025] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.789025] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.789025] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.789025] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.789025] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.790137] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.790511] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.790751] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.791199] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.797086] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.797086] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 3951dca7-fe43-456b-96a4-045e3518d5cb is going to be created. [ 971.823802] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.824435] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.824770] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.825308] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.825671] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.826067] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-3951dca7-fe43-456b-96a4-045e3518d5cb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.087272] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6aff3244-8376-4f32-8e71-5312a77febc9: rpc.has_security_group_logging(os_id): False [ 972.110347] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.110444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.110487] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.110706] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.110828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.111041] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.112273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.112273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.112273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.112273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.112273] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6aff3244-8376-4f32-8e71-5312a77febc9 is going to be created. [ 972.186897] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.187061] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.187135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.187392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.187631] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.203468] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6aff3244-8376-4f32-8e71-5312a77febc9 in Status: IN_PROGRESS for 2s [ 972.280729] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.502041] env[69343]: INFO networking_nsxv3.common.synchronization [req-e49ec6a0-d949-417e-98ca-34c9c1ae8942 req-5731c8ae-4771-44ab-976d-2e65a374fd68 service nova] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_rules [ 972.502405] env[69343]: INFO networking_nsxv3.common.synchronization [req-e49ec6a0-d949-417e-98ca-34c9c1ae8942 req-5731c8ae-4771-44ab-976d-2e65a374fd68 service nova] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 972.502646] env[69343]: INFO networking_nsxv3.common.synchronization [req-e49ec6a0-d949-417e-98ca-34c9c1ae8942 req-5731c8ae-4771-44ab-976d-2e65a374fd68 service nova] Enqueued Resource ID: 3951dca7-fe43-456b-96a4-045e3518d5cb with Priority: HIGHEST for action port [ 972.503087] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_rules [ 972.504109] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 972.504109] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3951dca7-fe43-456b-96a4-045e3518d5cb with Priority: HIGHEST for action port [ 972.504109] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.504354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.504354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.504564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.504773] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.505879] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.505879] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.506357] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-3951dca7-fe43-456b-96a4-045e3518d5cb taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.506519] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3951dca7-fe43-456b-96a4-045e3518d5cb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.506594] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3951dca7-fe43-456b-96a4-045e3518d5cb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.506810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3951dca7-fe43-456b-96a4-045e3518d5cb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.506891] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3951dca7-fe43-456b-96a4-045e3518d5cb',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.784127] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.010791] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.010791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.010986] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3951dca7-fe43-456b-96a4-045e3518d5cb with status ACTIVE [ 973.011130] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.011255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.011326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.011533] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.011625] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.012220] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.012220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.012220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.012220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.012612] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.012612] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.012612] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.012612] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.012923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.012923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.013096] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3951dca7-fe43-456b-96a4-045e3518d5cb is going to be updated. [ 973.037611] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.037728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.037785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.037999] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.038180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.038666] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3951dca7-fe43-456b-96a4-045e3518d5cb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.056409] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413f66d2-4c29-4e75-be43-518af1022160 in Status: SUCCESS [ 973.056661] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.056839] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.057070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.057284] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.057510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.057510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.057676] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.057756] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.057851] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('413f66d2-4c29-4e75-be43-518af1022160',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.060232] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd in Status: SUCCESS [ 973.060409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.060946] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.061450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.061663] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.061741] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.065022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.065022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.065022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.065022] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.286987] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.287670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.287824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.288347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.288347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.288347] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 973.361177] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.361390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.361390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.361604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.361750] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.371800] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 973.395016] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: SUCCESS [ 973.395467] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 deletion is rescheduled due to dependency. [ 973.395467] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.395641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.395880] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.396117] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.396321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.396490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.396673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.396796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.396925] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.564659] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.564883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.567063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.567370] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.567572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.567820] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.567943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.568170] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.568334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.568334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.568404] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 413f66d2-4c29-4e75-be43-518af1022160 is going to be deleted. [ 973.569505] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.643098] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.643098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.643098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.643098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.643098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.643098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.643098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.643098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.643098] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.643098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.643098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.643098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.643098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.643098] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('413f66d2-4c29-4e75-be43-518af1022160',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.900494] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.074068] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.147621] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.147802] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.147865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.148086] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.148183] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.148385] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.148483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.148549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.148683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.148759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.148844] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 413f66d2-4c29-4e75-be43-518af1022160 already deleted. [ 974.148922] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.149035] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('413f66d2-4c29-4e75-be43-518af1022160',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.149959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.150170] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.150327] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.150428] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.150521] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.150638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.150716] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.150804] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('413f66d2-4c29-4e75-be43-518af1022160',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.218593] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6aff3244-8376-4f32-8e71-5312a77febc9 in Status: SUCCESS [ 974.218593] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.403598] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.575993] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.576207] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.576324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.576557] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.576684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.576802] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd is going to be updated. [ 974.622639] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.622863] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.622910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.623152] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.623396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.635628] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd in Status: IN_PROGRESS for 2s [ 974.653651] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('413f66d2-4c29-4e75-be43-518af1022160',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.654462] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.654672] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.654746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.655255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.655255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.655382] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.655438] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.655489] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.655648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.655727] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.655819] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 413f66d2-4c29-4e75-be43-518af1022160 already deleted. [ 974.655899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.906619] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.907011] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.907011] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.907133] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.910123] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.910123] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 is going to be updated. [ 974.947168] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.947378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.947378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.948389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.948389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.962517] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: IN_PROGRESS for 2s [ 975.154522] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 413f66d2-4c29-4e75-be43-518af1022160: rpc.has_security_group_logging(os_id): False [ 975.177563] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.177719] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.177793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.178043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.178143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.182361] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.182361] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.182361] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.182361] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.182361] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.182361] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 413f66d2-4c29-4e75-be43-518af1022160 is going to be created. [ 975.205716] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/413f66d2-4c29-4e75-be43-518af1022160], does not exist path=[/infra/domains/default/groups/413f66d2-4c29-4e75-be43-518af1022160]."\n}' [ 975.207309] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 413f66d2-4c29-4e75-be43-518af1022160 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/413f66d2-4c29-4e75-be43-518af1022160 [ 975.207552] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 975.258824] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.258972] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.259053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.259290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.260707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.261060] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.261343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.261343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.261506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.262728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.263191] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.263354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.263439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.263671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.263787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.264072] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 413f66d2-4c29-4e75-be43-518af1022160 is going to be created. [ 975.288226] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/413f66d2-4c29-4e75-be43-518af1022160], does not exist path=[/infra/domains/default/groups/413f66d2-4c29-4e75-be43-518af1022160]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/413f66d2-4c29-4e75-be43-518af1022160 [ 975.288424] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-413f66d2-4c29-4e75-be43-518af1022160" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.288674] env[69343]: Traceback (most recent call last): [ 975.288740] env[69343]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 975.288740] env[69343]: return func(*args, **kwargs) [ 975.288740] env[69343]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 975.288740] env[69343]: res.raise_for_status() [ 975.288740] env[69343]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 975.288740] env[69343]: raise HTTPError(http_error_msg, response=self) [ 975.288740] env[69343]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/413f66d2-4c29-4e75-be43-518af1022160 [ 975.288740] env[69343]: During handling of the above exception, another exception occurred: [ 975.288740] env[69343]: Traceback (most recent call last): [ 975.288740] env[69343]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 975.288740] env[69343]: listener.cb(fileno) [ 975.288740] env[69343]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 975.288740] env[69343]: result = function(*args, **kwargs) [ 975.288740] env[69343]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 975.288740] env[69343]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 975.288740] env[69343]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 975.288740] env[69343]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 975.288740] env[69343]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 975.288740] env[69343]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 975.288740] env[69343]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 975.288740] env[69343]: res.raise_for_status() [ 975.288740] env[69343]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 975.288740] env[69343]: raise HTTPError(http_error_msg, response=self) [ 975.288740] env[69343]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/413f66d2-4c29-4e75-be43-518af1022160 [ 975.288740] env[69343]: Removing descriptor: 37 [ 975.383028] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 975.383296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.383503] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.383737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.383931] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.384059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.384622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.384622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.384622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.384622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.384622] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.891026] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.891026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.891026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.891026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.891026] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.891026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.891026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.891026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.891026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.891026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.891026] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.891026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.891026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.891026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.891026] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.891026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.891722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.891722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.891722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.891722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.892593] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.396036] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ff65ed7-3c36-4248-86bb-8bb20a53fde4: rpc.has_security_group_logging(os_id): False [ 976.417542] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.417728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.417764] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.418098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.441724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.442090] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.442241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.442304] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.442627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.442627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.442794] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.442885] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.442950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.443132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.443214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.443389] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.443478] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.443540] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.444178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.444300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.444400] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 976.510580] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.510761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.510877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.511060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.511255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.523961] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 976.646807] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd in Status: SUCCESS [ 976.647037] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.647296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.647522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.647781] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.647899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.647899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.648088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.648206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.648290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.648384] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.649283] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.649466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.649636] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.649784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.649878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.650032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.650161] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.650255] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.974601] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: SUCCESS [ 976.974944] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.975226] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.976241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.976241] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.976241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.976241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.976485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.976522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.976669] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.976833] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.152263] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.152395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.152588] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.481264] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.505110] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 977.505110] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 977.657648] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.791345] env[69343]: INFO networking_nsxv3.common.synchronization [req-80030fd8-df5c-4fab-9a06-0aec42fe710b req-ffbd9d58-dc37-4e5e-ad4c-e830cf73dc0f tempest-AttachVolumeTestJSON-1370042024 tempest-AttachVolumeTestJSON-1370042024-project-member] Enqueued Resource ID: 69f44a11-7085-48b3-ad36-634a77d99f4a with Priority: HIGHEST for action security_group_members [ 977.792111] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f44a11-7085-48b3-ad36-634a77d99f4a with Priority: HIGHEST for action security_group_members [ 977.792453] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f44a11-7085-48b3-ad36-634a77d99f4a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.792585] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.792656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.792919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.793178] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.793283] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.793342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.793509] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.793591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.793687] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f44a11-7085-48b3-ad36-634a77d99f4a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.983717] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 970edbb8-6a58-46c8-ad52-fe607c6c28e9: rpc.has_security_group_logging(os_id): False [ 978.011245] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.011245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.011425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.011479] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.039243] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.039592] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.039722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.039768] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.039977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.040059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.040253] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 is going to be updated. [ 978.143464] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.145849] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.145849] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.145849] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.145849] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.164078] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: IN_PROGRESS for 2s [ 978.164712] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.165022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.165268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.165567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.165767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.165957] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd is going to be updated. [ 978.249030] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.249199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.249199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.249505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.249764] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.262682] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd in Status: IN_PROGRESS for 2s [ 978.300656] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.302305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.302305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.302305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.302305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.302305] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.302305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.302305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.302305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.302870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.303059] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f44a11-7085-48b3-ad36-634a77d99f4a already deleted. [ 978.303474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.448205] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-93 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.448205] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-93" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.448205] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-93" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.448205] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-93" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.448205] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.448205] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.448205] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.450506] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.450893] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.451380] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 978.454043] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.454043] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.454043] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.454043] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 978.454043] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.454043] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 978.476185] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 978.476447] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 978.478513] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 978.478513] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-93" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.478513] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-18b07f65-cdd4-422a-af6b-9d8feff13f79 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.478513] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-18b07f65-cdd4-422a-af6b-9d8feff13f79" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.478513] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-18b07f65-cdd4-422a-af6b-9d8feff13f79" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.478513] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-18b07f65-cdd4-422a-af6b-9d8feff13f79" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.478513] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18b07f65-cdd4-422a-af6b-9d8feff13f79',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.542165] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 978.542483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.984031] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.984031] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.984031] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.984031] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.984031] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.984031] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 18b07f65-cdd4-422a-af6b-9d8feff13f79 not found, creating... [ 978.984031] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.984031] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.984031] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.984031] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.984031] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.984504] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.984645] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.984846] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.985126] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.986085] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.986085] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 18b07f65-cdd4-422a-af6b-9d8feff13f79 is going to be created. [ 979.013018] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.013275] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.013407] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.013686] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.013921] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.014224] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-18b07f65-cdd4-422a-af6b-9d8feff13f79" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.752300] env[69343]: INFO networking_nsxv3.common.synchronization [req-2b090175-9655-419b-9d20-3c3701859bcf req-6d1e9d20-20c7-45f9-9f26-72a129911c68 tempest-ServerRescueTestJSONUnderV235-521676157 tempest-ServerRescueTestJSONUnderV235-521676157-project-member] Enqueued Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_members [ 979.752969] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd with Priority: HIGHEST for action security_group_members [ 979.756196] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.756357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.170899] env[69343]: INFO networking_nsxv3.common.synchronization [req-80030fd8-df5c-4fab-9a06-0aec42fe710b req-fa6e3a97-39c9-4ae8-96d0-3e2c418d67fa service nova] Enqueued Resource ID: 69f44a11-7085-48b3-ad36-634a77d99f4a with Priority: HIGHEST for action security_group_rules [ 980.171102] env[69343]: INFO networking_nsxv3.common.synchronization [req-80030fd8-df5c-4fab-9a06-0aec42fe710b req-fa6e3a97-39c9-4ae8-96d0-3e2c418d67fa service nova] Enqueued Resource ID: 69f44a11-7085-48b3-ad36-634a77d99f4a with Priority: HIGHEST for action security_group_members [ 980.171294] env[69343]: INFO networking_nsxv3.common.synchronization [req-80030fd8-df5c-4fab-9a06-0aec42fe710b req-fa6e3a97-39c9-4ae8-96d0-3e2c418d67fa service nova] Enqueued Resource ID: 18b07f65-cdd4-422a-af6b-9d8feff13f79 with Priority: HIGHEST for action port [ 980.171590] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f44a11-7085-48b3-ad36-634a77d99f4a with Priority: HIGHEST for action security_group_rules [ 980.171731] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f44a11-7085-48b3-ad36-634a77d99f4a with Priority: HIGHEST for action security_group_members [ 980.171846] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b07f65-cdd4-422a-af6b-9d8feff13f79 with Priority: HIGHEST for action port [ 980.172863] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f44a11-7085-48b3-ad36-634a77d99f4a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.172863] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.172863] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.173057] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.173057] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f44a11-7085-48b3-ad36-634a77d99f4a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.173979] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f44a11-7085-48b3-ad36-634a77d99f4a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.173979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.174140] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.174187] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.174325] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.174559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.174559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.174800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.174800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.174800] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f44a11-7085-48b3-ad36-634a77d99f4a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.175732] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-18b07f65-cdd4-422a-af6b-9d8feff13f79 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.175732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18b07f65-cdd4-422a-af6b-9d8feff13f79" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.175732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18b07f65-cdd4-422a-af6b-9d8feff13f79" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.176022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18b07f65-cdd4-422a-af6b-9d8feff13f79" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.176022] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18b07f65-cdd4-422a-af6b-9d8feff13f79',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.179594] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: SUCCESS [ 980.179594] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.274974] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd in Status: SUCCESS [ 980.275167] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.275334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.275553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.275741] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.275857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.275921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.276089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.276173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.276268] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.678911] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f44a11-7085-48b3-ad36-634a77d99f4a taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.678911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.678911] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69f44a11-7085-48b3-ad36-634a77d99f4a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.680863] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18b07f65-cdd4-422a-af6b-9d8feff13f79 with status ACTIVE [ 980.680863] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.680863] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.680863] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.681237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.681296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.681568] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.681718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.681817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.682205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.682271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.682510] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.682657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.682760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.682978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.683155] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.683294] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18b07f65-cdd4-422a-af6b-9d8feff13f79 is going to be updated. [ 980.708023] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.708171] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.708266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.708459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.708605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.708772] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18b07f65-cdd4-422a-af6b-9d8feff13f79" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.778565] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.778918] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.778918] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.778992] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.803319] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.803527] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.803645] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.803713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.803922] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.803996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.804243] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd is going to be updated. [ 980.860029] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.860029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.860029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.860029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.860029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.876903] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd in Status: IN_PROGRESS for 2s [ 981.180650] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69f44a11-7085-48b3-ad36-634a77d99f4a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.686017] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.686408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.686500] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.686735] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.686830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.687650] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f44a11-7085-48b3-ad36-634a77d99f4a is going to be created. [ 981.726979] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.728100] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.728100] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.730062] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.730062] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.754591] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f44a11-7085-48b3-ad36-634a77d99f4a in Status: UNINITIALIZED for 2s [ 981.977483] env[69343]: INFO networking_nsxv3.common.synchronization [None req-3dec1e49-7342-4c92-bb7d-2ef4e40ba2de None None] Enqueued Resource ID: f7475527-d6b7-445e-b2fa-bafc412fe731 with Priority: HIGHEST for action port [ 981.977483] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7475527-d6b7-445e-b2fa-bafc412fe731 with Priority: HIGHEST for action port [ 981.977483] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7475527-d6b7-445e-b2fa-bafc412fe731 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.979263] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7475527-d6b7-445e-b2fa-bafc412fe731" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.979636] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7475527-d6b7-445e-b2fa-bafc412fe731" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.981227] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7475527-d6b7-445e-b2fa-bafc412fe731" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.981227] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7475527-d6b7-445e-b2fa-bafc412fe731',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.486512] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7475527-d6b7-445e-b2fa-bafc412fe731 [ 982.486781] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.486922] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.487039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.487945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.487945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.487945] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7475527-d6b7-445e-b2fa-bafc412fe731 already deleted. [ 982.487945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7475527-d6b7-445e-b2fa-bafc412fe731" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.889129] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd in Status: SUCCESS [ 982.892809] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd deletion is rescheduled due to dependency. [ 982.892809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.892809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.892809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.892809] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.892809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.892809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.892809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.892809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.892809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.892809] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.892809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.892809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.892809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.892809] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.892809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.892809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.892809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.893605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.893605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.893605] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.893605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.893605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.893605] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.893605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.893823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.893823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.893881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.894078] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.395389] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd: rpc.has_security_group_logging(os_id): False [ 983.399222] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.399366] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.399434] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.399650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.399742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.399951] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.400095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.400501] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.400501] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.400658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.400658] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd is going to be updated. [ 983.438964] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.439260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.439260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.439357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.439392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.439563] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.439662] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.439724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.439871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.439948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.440179] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.440272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.440333] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.440437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.440511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.440708] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.440803] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.440865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.441011] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.441171] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.441171] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd is going to be updated. [ 983.476273] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.476415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.476481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.476709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.476853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.513540] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd in Status: IN_PROGRESS for 2s [ 983.557840] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.557993] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.558085] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.558553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.558553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.580549] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd in Status: IN_PROGRESS for 2s [ 983.779758] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f44a11-7085-48b3-ad36-634a77d99f4a in Status: SUCCESS [ 983.779899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.780206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.780600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.780600] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.781020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.781020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.781020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.781020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.781020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.781331] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69f44a11-7085-48b3-ad36-634a77d99f4a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.285407] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69f44a11-7085-48b3-ad36-634a77d99f4a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.788529] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69f44a11-7085-48b3-ad36-634a77d99f4a: rpc.has_security_group_logging(os_id): False [ 984.816423] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.816681] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.816767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.817029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.817158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.821715] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.821964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.821964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.823596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.823596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.823596] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f44a11-7085-48b3-ad36-634a77d99f4a is going to be created. [ 984.894013] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.894013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.894013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.894236] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.894271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.912613] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f44a11-7085-48b3-ad36-634a77d99f4a in Status: IN_PROGRESS for 2s [ 985.051707] env[69343]: INFO networking_nsxv3.common.synchronization [req-a5237ad4-f6d4-441a-ae54-35fa756b94f2 req-3f08f724-62f1-486d-b4eb-67f920afa754 tempest-ServersTestJSON-245111932 tempest-ServersTestJSON-245111932-project-member] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 985.051707] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 985.051707] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.051707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.051707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.051707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.051707] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.052641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.052947] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.054450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.054450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.054450] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.057238] env[69343]: INFO networking_nsxv3.common.synchronization [req-44e98708-e0af-4a94-a2a3-48d434de8d51 req-cdbfec5d-7e5a-4a04-aabf-b0bcef9382c8 tempest-ServerDiskConfigTestJSON-1018188129 tempest-ServerDiskConfigTestJSON-1018188129-project-member] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 985.057471] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 985.057996] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.058219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.058219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.058454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.058496] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.058579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.058640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.058886] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.058886] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.061074] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.529098] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd in Status: SUCCESS [ 985.529098] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd deletion is rescheduled due to dependency. [ 985.529233] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.559916] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.561117] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.561288] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.561331] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.561564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.593574] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.594238] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.594436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.595584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.595584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.595584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.595584] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 985.598478] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd in Status: SUCCESS [ 985.598750] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.598951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.599183] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.599273] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.630289] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.630452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.630656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.630921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.631510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.645600] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 985.661375] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.662814] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.662814] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.662814] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.662814] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.662814] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.662814] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.663228] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.664333] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.664790] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.664978] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.665125] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.665244] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.665364] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.665477] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.665634] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.697512] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.697512] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 985.697645] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.697824] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.698196] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-c1b11c4f-f935-4be7-8a33-56f4790fc91a taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.698383] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-c1b11c4f-f935-4be7-8a33-56f4790fc91a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.698556] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-c1b11c4f-f935-4be7-8a33-56f4790fc91a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.698877] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-c1b11c4f-f935-4be7-8a33-56f4790fc91a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.703232] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1b11c4f-f935-4be7-8a33-56f4790fc91a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.070417] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.124032] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.124032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.124032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.124032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.124032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.124032] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd is going to be deleted. [ 986.187565] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.188843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.188843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.188843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.188843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.188843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4f949f5-d8e6-4fa4-8e1b-82fd83dac2fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.206590] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.206590] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.206590] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.206590] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.206590] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.206590] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port c1b11c4f-f935-4be7-8a33-56f4790fc91a not found, creating... [ 986.207175] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.207425] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.207599] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.207973] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.208238] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.208590] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.208807] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.208972] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.209353] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.209548] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.209734] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: c1b11c4f-f935-4be7-8a33-56f4790fc91a is going to be created. [ 986.236809] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.237037] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.237278] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.237655] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.238727] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.239044] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-c1b11c4f-f935-4be7-8a33-56f4790fc91a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.575097] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.575381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.575525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.575809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.575911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.576026] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 986.610690] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.610877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.610922] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.611179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.611333] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.624137] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 986.931314] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69f44a11-7085-48b3-ad36-634a77d99f4a in Status: SUCCESS [ 986.931451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.981708] env[69343]: INFO networking_nsxv3.common.synchronization [req-44e98708-e0af-4a94-a2a3-48d434de8d51 req-32a3ccdc-6cb9-4483-b679-173b6d7efd33 service nova] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_rules [ 986.981912] env[69343]: INFO networking_nsxv3.common.synchronization [req-44e98708-e0af-4a94-a2a3-48d434de8d51 req-32a3ccdc-6cb9-4483-b679-173b6d7efd33 service nova] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 986.982111] env[69343]: INFO networking_nsxv3.common.synchronization [req-44e98708-e0af-4a94-a2a3-48d434de8d51 req-32a3ccdc-6cb9-4483-b679-173b6d7efd33 service nova] Enqueued Resource ID: c1b11c4f-f935-4be7-8a33-56f4790fc91a with Priority: HIGHEST for action port [ 986.982651] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_rules [ 986.982816] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 986.982867] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1b11c4f-f935-4be7-8a33-56f4790fc91a with Priority: HIGHEST for action port [ 986.984191] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.984191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.984191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.984191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.984191] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.984989] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.985098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.985293] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1b11c4f-f935-4be7-8a33-56f4790fc91a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.985630] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1b11c4f-f935-4be7-8a33-56f4790fc91a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.985703] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1b11c4f-f935-4be7-8a33-56f4790fc91a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.985834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1b11c4f-f935-4be7-8a33-56f4790fc91a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.985906] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1b11c4f-f935-4be7-8a33-56f4790fc91a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.488678] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.488678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.488678] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1b11c4f-f935-4be7-8a33-56f4790fc91a with status ACTIVE [ 987.488678] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.488678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.488678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.489485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.489485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.489485] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.489485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.489485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.489485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.489485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.489875] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.489875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.489875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.490115] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.490115] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.490115] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1b11c4f-f935-4be7-8a33-56f4790fc91a is going to be updated. [ 987.520037] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.520708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.520708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.520708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.520708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.520708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1b11c4f-f935-4be7-8a33-56f4790fc91a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.661148] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 987.661371] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b deletion is rescheduled due to dependency. [ 987.661504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.661677] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.661938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.662450] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.662450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.662450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.662676] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.662676] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.662757] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.171024] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.560352] env[69343]: INFO networking_nsxv3.common.synchronization [None req-92712904-edaa-45eb-9b44-a4ee3f830724 None None] Enqueued Resource ID: 2fff5552-199c-429f-985e-c5998452eaff with Priority: HIGHEST for action port [ 988.561421] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fff5552-199c-429f-985e-c5998452eaff with Priority: HIGHEST for action port [ 988.561905] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fff5552-199c-429f-985e-c5998452eaff taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.562248] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fff5552-199c-429f-985e-c5998452eaff" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.562344] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fff5552-199c-429f-985e-c5998452eaff" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.562606] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fff5552-199c-429f-985e-c5998452eaff" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.562695] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fff5552-199c-429f-985e-c5998452eaff',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.637080] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 988.637080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.674441] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.064815] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fff5552-199c-429f-985e-c5998452eaff [ 989.064815] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.064815] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.064815] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.065076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.065203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.065252] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fff5552-199c-429f-985e-c5998452eaff already deleted. [ 989.065312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fff5552-199c-429f-985e-c5998452eaff" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.177176] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.177299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.177299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.177774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.177774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.177774] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 989.213031] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.213161] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.213245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.213494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.214555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.225035] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 990.344750] env[69343]: INFO networking_nsxv3.common.synchronization [None req-97b79bb8-83f0-4185-a5b8-97e13bc25c1b None None] Enqueued Resource ID: 569a1afb-2aa3-4c9b-8b8b-030490ab53d8 with Priority: HIGHEST for action port [ 990.345377] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 569a1afb-2aa3-4c9b-8b8b-030490ab53d8 with Priority: HIGHEST for action port [ 990.345688] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-569a1afb-2aa3-4c9b-8b8b-030490ab53d8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.345814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-569a1afb-2aa3-4c9b-8b8b-030490ab53d8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.346009] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-569a1afb-2aa3-4c9b-8b8b-030490ab53d8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.346856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-569a1afb-2aa3-4c9b-8b8b-030490ab53d8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.346945] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('569a1afb-2aa3-4c9b-8b8b-030490ab53d8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.849261] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 569a1afb-2aa3-4c9b-8b8b-030490ab53d8 [ 990.849510] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.849640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.849710] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.850997] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.851137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.851831] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:569a1afb-2aa3-4c9b-8b8b-030490ab53d8 already deleted. [ 990.851831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-569a1afb-2aa3-4c9b-8b8b-030490ab53d8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.956536] env[69343]: INFO networking_nsxv3.common.synchronization [None req-c78c5e88-424e-41c8-809b-a55e950d8c14 None None] Enqueued Resource ID: f1cfe21c-c433-4be7-98d2-bff710f5766d with Priority: HIGHEST for action port [ 990.959731] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1cfe21c-c433-4be7-98d2-bff710f5766d with Priority: HIGHEST for action port [ 990.961508] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1cfe21c-c433-4be7-98d2-bff710f5766d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.962413] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1cfe21c-c433-4be7-98d2-bff710f5766d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.962623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1cfe21c-c433-4be7-98d2-bff710f5766d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.963122] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1cfe21c-c433-4be7-98d2-bff710f5766d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.963288] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1cfe21c-c433-4be7-98d2-bff710f5766d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.238324] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 991.238324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.238873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.239120] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.240810] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.240810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.240810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.240810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.240810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.240810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.240810] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.469697] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1cfe21c-c433-4be7-98d2-bff710f5766d [ 991.469697] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.470163] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.470163] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.470263] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.470317] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.470418] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1cfe21c-c433-4be7-98d2-bff710f5766d already deleted. [ 991.470567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1cfe21c-c433-4be7-98d2-bff710f5766d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.743051] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.743252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.743324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.743560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.743740] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.743845] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.743907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.744111] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.744213] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.744355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.744464] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.744585] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.744642] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.745249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.745249] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.745249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.745249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.745249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.745561] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.745561] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.745561] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.756956] env[69343]: INFO networking_nsxv3.common.synchronization [None req-fd6e5e92-e137-4b44-a866-f1847f2aae02 tempest-ServersV294TestFqdnHostnames-1416518199 tempest-ServersV294TestFqdnHostnames-1416518199-project-member] Enqueued Resource ID: fdbb645d-14e7-4764-8083-5c521a4adb8c with Priority: HIGHEST for action security_group_rules [ 991.757578] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbb645d-14e7-4764-8083-5c521a4adb8c with Priority: HIGHEST for action security_group_rules [ 991.758104] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdbb645d-14e7-4764-8083-5c521a4adb8c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.758104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.758754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.759298] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.759589] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdbb645d-14e7-4764-8083-5c521a4adb8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.921316] env[69343]: INFO networking_nsxv3.common.synchronization [None req-3fd4cd8d-b0d9-4493-a5df-6fc6240aab5f tempest-ServersV294TestFqdnHostnames-1416518199 tempest-ServersV294TestFqdnHostnames-1416518199-project-member] Enqueued Resource ID: fdbb645d-14e7-4764-8083-5c521a4adb8c with Priority: HIGHEST for action security_group_rules [ 991.921316] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbb645d-14e7-4764-8083-5c521a4adb8c with Priority: HIGHEST for action security_group_rules [ 991.921316] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdbb645d-14e7-4764-8083-5c521a4adb8c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.921316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.251849] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3973f86f-0821-4b7d-9e21-ccfe561c705b: rpc.has_security_group_logging(os_id): False [ 992.274758] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.274758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.274967] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.275035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.275116] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.275441] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.275783] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.275783] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.275896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.275967] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.276208] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.276312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.276374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.276588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.276588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.276773] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.276861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.276927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.277309] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.277459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.277679] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 992.291764] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.291911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.291983] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.292309] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.292436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.292545] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdbb645d-14e7-4764-8083-5c521a4adb8c already deleted. [ 992.292584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.292755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.293270] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.293270] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdbb645d-14e7-4764-8083-5c521a4adb8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.355617] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.355787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.355848] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.357914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.357914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.374553] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 992.928639] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.929071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.929071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.929475] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.929475] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.929636] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdbb645d-14e7-4764-8083-5c521a4adb8c already deleted. [ 992.929673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.222180] env[69343]: INFO networking_nsxv3.common.synchronization [req-04990692-0a9b-43e7-938d-6c08104fb87e req-2c42378d-2695-4def-bf1b-d229175206ce tempest-FloatingIPsAssociationTestJSON-927978617 tempest-FloatingIPsAssociationTestJSON-927978617-project-member] Enqueued Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGHEST for action security_group_members [ 993.228022] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGHEST for action security_group_members [ 993.228022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.228022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.228022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.228022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.229554] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.229756] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.229862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.230203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.230688] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.231288] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.734428] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.238454] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.302103] env[69343]: INFO networking_nsxv3.common.synchronization [None req-9a3a176f-4e86-4b8f-854b-5f902c9a41a7 None None] Enqueued Resource ID: 9c61762b-76d7-4967-afc6-8c925cafe799 with Priority: HIGHEST for action port [ 994.302103] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c61762b-76d7-4967-afc6-8c925cafe799 with Priority: HIGHEST for action port [ 994.302103] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c61762b-76d7-4967-afc6-8c925cafe799 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.302103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c61762b-76d7-4967-afc6-8c925cafe799" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.302103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c61762b-76d7-4967-afc6-8c925cafe799" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.302340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c61762b-76d7-4967-afc6-8c925cafe799" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.302426] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c61762b-76d7-4967-afc6-8c925cafe799',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.393366] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 994.394136] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.429305] env[69343]: INFO networking_nsxv3.common.synchronization [None req-f6d019ee-2f86-4007-8fb9-448fc1c21be1 None None] Enqueued Resource ID: e11a9d44-e4da-46c9-96cc-994b615bb335 with Priority: HIGHEST for action port [ 994.431474] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e11a9d44-e4da-46c9-96cc-994b615bb335 with Priority: HIGHEST for action port [ 994.431928] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-e11a9d44-e4da-46c9-96cc-994b615bb335 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.432329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e11a9d44-e4da-46c9-96cc-994b615bb335" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.432452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e11a9d44-e4da-46c9-96cc-994b615bb335" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.432838] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e11a9d44-e4da-46c9-96cc-994b615bb335" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.433720] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e11a9d44-e4da-46c9-96cc-994b615bb335',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.560538] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-9 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.560790] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.560790] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.563295] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.563295] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.563295] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.563295] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.563295] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.563295] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.563295] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.563295] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.563295] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.563600] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.563600] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.563924] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.563924] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.741223] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.741356] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.741356] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.742365] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.742365] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.742365] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e is going to be updated. [ 994.756444] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.756565] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.193 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 994.756619] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.756863] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.757152] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-3e628f00-62fd-4df0-b77c-09c30307c529 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.757345] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-3e628f00-62fd-4df0-b77c-09c30307c529" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.757472] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-3e628f00-62fd-4df0-b77c-09c30307c529" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.757822] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-3e628f00-62fd-4df0-b77c-09c30307c529" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.757959] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e628f00-62fd-4df0-b77c-09c30307c529',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.777903] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.778057] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.778129] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.778328] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.778518] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.794661] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e in Status: IN_PROGRESS for 2s [ 994.804911] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c61762b-76d7-4967-afc6-8c925cafe799 [ 994.805173] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.805325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.805398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.805611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.805700] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.805798] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c61762b-76d7-4967-afc6-8c925cafe799 already deleted. [ 994.805878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c61762b-76d7-4967-afc6-8c925cafe799" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.941491] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e11a9d44-e4da-46c9-96cc-994b615bb335 [ 994.941771] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.941875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.941875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.942627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.942627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.942627] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e11a9d44-e4da-46c9-96cc-994b615bb335 already deleted. [ 994.942627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e11a9d44-e4da-46c9-96cc-994b615bb335" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.261099] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.261411] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.261451] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.261733] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.262042] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.262087] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 3e628f00-62fd-4df0-b77c-09c30307c529 not found, creating... [ 995.262614] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.262614] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.263810] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.263810] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.263810] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.263810] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.263810] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.263810] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.263810] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.264050] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.265305] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 3e628f00-62fd-4df0-b77c-09c30307c529 is going to be created. [ 995.290114] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.290348] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.290479] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.290864] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.291017] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.291260] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-3e628f00-62fd-4df0-b77c-09c30307c529" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.000827] env[69343]: INFO networking_nsxv3.common.synchronization [None req-d2a7f356-884b-4115-8d49-7c0fd2bcfbee None None] Enqueued Resource ID: 3cfd16a0-9d0a-4cb2-9e08-21ca4a0faac2 with Priority: HIGHEST for action port [ 996.003078] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cfd16a0-9d0a-4cb2-9e08-21ca4a0faac2 with Priority: HIGHEST for action port [ 996.004588] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cfd16a0-9d0a-4cb2-9e08-21ca4a0faac2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.004588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cfd16a0-9d0a-4cb2-9e08-21ca4a0faac2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.006139] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cfd16a0-9d0a-4cb2-9e08-21ca4a0faac2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.006139] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cfd16a0-9d0a-4cb2-9e08-21ca4a0faac2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.006139] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cfd16a0-9d0a-4cb2-9e08-21ca4a0faac2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.285255] env[69343]: INFO networking_nsxv3.common.synchronization [req-04990692-0a9b-43e7-938d-6c08104fb87e req-d72ac79c-9526-4336-a19c-29d63858cb58 service nova] Enqueued Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGHEST for action security_group_rules [ 996.285255] env[69343]: INFO networking_nsxv3.common.synchronization [req-04990692-0a9b-43e7-938d-6c08104fb87e req-d72ac79c-9526-4336-a19c-29d63858cb58 service nova] Enqueued Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGHEST for action security_group_members [ 996.285255] env[69343]: INFO networking_nsxv3.common.synchronization [req-04990692-0a9b-43e7-938d-6c08104fb87e req-d72ac79c-9526-4336-a19c-29d63858cb58 service nova] Enqueued Resource ID: 3e628f00-62fd-4df0-b77c-09c30307c529 with Priority: HIGHEST for action port [ 996.285255] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGHEST for action security_group_rules [ 996.285255] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGHEST for action security_group_members [ 996.285255] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e628f00-62fd-4df0-b77c-09c30307c529 with Priority: HIGHEST for action port [ 996.285255] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.285843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.285843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.285843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.285843] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.286763] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.286861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.287054] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e628f00-62fd-4df0-b77c-09c30307c529 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.287181] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e628f00-62fd-4df0-b77c-09c30307c529" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.287236] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e628f00-62fd-4df0-b77c-09c30307c529" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.287571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e628f00-62fd-4df0-b77c-09c30307c529" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.287571] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e628f00-62fd-4df0-b77c-09c30307c529',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.373272] env[69343]: INFO networking_nsxv3.common.synchronization [req-fc3f63d9-9884-4d40-9d26-a49b590a669a req-5d360341-68f0-409c-b185-7220b373cbda tempest-AttachVolumeNegativeTest-1961671669 tempest-AttachVolumeNegativeTest-1961671669-project-member] Enqueued Resource ID: 7532335d-79e6-454d-9693-a5b2f8a9923a with Priority: HIGHEST for action security_group_members [ 996.376537] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7532335d-79e6-454d-9693-a5b2f8a9923a with Priority: HIGHEST for action security_group_members [ 996.376537] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7532335d-79e6-454d-9693-a5b2f8a9923a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.376537] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.376537] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.376537] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.376537] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.377043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.377043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.377043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.377138] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.377210] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7532335d-79e6-454d-9693-a5b2f8a9923a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.508326] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cfd16a0-9d0a-4cb2-9e08-21ca4a0faac2 [ 996.508562] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.508696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.508763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.508989] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.509095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.509193] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cfd16a0-9d0a-4cb2-9e08-21ca4a0faac2 already deleted. [ 996.509525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cfd16a0-9d0a-4cb2-9e08-21ca4a0faac2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.789443] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.792446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.792446] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e628f00-62fd-4df0-b77c-09c30307c529 with status ACTIVE [ 996.792446] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.792446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.792446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.792446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.792446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.792446] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.792446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.792446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.792446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.792446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.792840] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.792840] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.792840] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.793049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.793460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.793871] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e628f00-62fd-4df0-b77c-09c30307c529 is going to be updated. [ 996.812178] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e in Status: SUCCESS [ 996.812178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.812178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.812178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.812178] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.812178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.812178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.812178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.812178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.812178] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.821598] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.821737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.821814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.822063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.822426] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.822426] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e628f00-62fd-4df0-b77c-09c30307c529" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.880495] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.880649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.880720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.880926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.907029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.907972] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.908649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.908928] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.909068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.909234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.909349] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7532335d-79e6-454d-9693-a5b2f8a9923a is going to be updated. [ 996.963407] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.963626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.963626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.963926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.963985] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.990217] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7532335d-79e6-454d-9693-a5b2f8a9923a in Status: IN_PROGRESS for 2s [ 997.317856] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.346903] env[69343]: INFO networking_nsxv3.common.synchronization [None req-a7a139aa-ace4-430c-b5d2-bb21cdd55b1f None None] Enqueued Resource ID: aa9615df-ee83-4368-9743-69621ffafb72 with Priority: HIGHEST for action port [ 997.346903] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa9615df-ee83-4368-9743-69621ffafb72 with Priority: HIGHEST for action port [ 997.346903] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa9615df-ee83-4368-9743-69621ffafb72 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.346903] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa9615df-ee83-4368-9743-69621ffafb72" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.346903] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa9615df-ee83-4368-9743-69621ffafb72" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.347655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa9615df-ee83-4368-9743-69621ffafb72" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.347856] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa9615df-ee83-4368-9743-69621ffafb72',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.823813] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.853403] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa9615df-ee83-4368-9743-69621ffafb72 [ 997.853403] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.853403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.853403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.853713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.853713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.853781] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa9615df-ee83-4368-9743-69621ffafb72 already deleted. [ 997.854576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa9615df-ee83-4368-9743-69621ffafb72" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.185532] env[69343]: INFO networking_nsxv3.common.synchronization [None req-08649501-fef5-4daa-b579-3b680f08d3aa None None] Enqueued Resource ID: b7afca00-a114-4faa-b459-e0cb4804c66c with Priority: HIGHEST for action port [ 998.185799] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7afca00-a114-4faa-b459-e0cb4804c66c with Priority: HIGHEST for action port [ 998.186438] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7afca00-a114-4faa-b459-e0cb4804c66c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.186578] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7afca00-a114-4faa-b459-e0cb4804c66c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.186640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7afca00-a114-4faa-b459-e0cb4804c66c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.187578] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7afca00-a114-4faa-b459-e0cb4804c66c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.187578] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7afca00-a114-4faa-b459-e0cb4804c66c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.329081] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.329081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.329081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.329081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.329081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.329081] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e is going to be updated. [ 998.379530] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.379771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.379914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.380295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.380536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.393547] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e in Status: IN_PROGRESS for 2s [ 998.697960] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7afca00-a114-4faa-b459-e0cb4804c66c [ 998.698248] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.699103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.699103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.699103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.699103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.699429] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7afca00-a114-4faa-b459-e0cb4804c66c already deleted. [ 998.699563] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7afca00-a114-4faa-b459-e0cb4804c66c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.000050] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7532335d-79e6-454d-9693-a5b2f8a9923a in Status: SUCCESS [ 999.000255] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7532335d-79e6-454d-9693-a5b2f8a9923a deletion is rescheduled due to dependency. [ 999.000371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.403600] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e in Status: SUCCESS [ 1000.403954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.403954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.404224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.404426] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.404543] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.404608] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.404756] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.404838] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.404924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.405026] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.763846] env[69343]: INFO networking_nsxv3.common.synchronization [req-5a712ce0-ca7a-4a40-a792-ac59ea60b083 req-80be6bcd-2fdf-4128-bc0d-c13c68981610 tempest-ImagesOneServerNegativeTestJSON-7986261 tempest-ImagesOneServerNegativeTestJSON-7986261-project-member] Enqueued Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1000.764512] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1000.764584] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.764667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.764717] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.764959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.765179] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.765281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.765342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.765492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.765572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.765660] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.909660] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.909660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.909660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.909660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.909660] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.909660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.909660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.909660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.909660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.909660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.910244] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.910244] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.910244] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.910598] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.910824] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.910908] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.910990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.911173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.911278] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.911385] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.911521] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.071898] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-275 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.071898] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-275" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.071898] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-275" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.072458] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-275" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.072989] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.073693] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.073823] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.074149] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.074542] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.074615] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1001.074686] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1001.075183] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1001.075183] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1001.075183] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1001.075183] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1001.076358] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1001.098633] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1001.098823] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1001.098954] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1001.099161] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-275" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.099500] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-fd6ce682-8144-43bd-9614-9f384f1f6d7b taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.099680] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-fd6ce682-8144-43bd-9614-9f384f1f6d7b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.099800] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-fd6ce682-8144-43bd-9614-9f384f1f6d7b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.100185] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-fd6ce682-8144-43bd-9614-9f384f1f6d7b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.100350] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd6ce682-8144-43bd-9614-9f384f1f6d7b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.267940] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.268141] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.268218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.268445] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.268547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.268763] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.268866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.268931] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.269116] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.269749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.269749] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 already deleted. [ 1001.269749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.413782] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e: rpc.has_security_group_logging(os_id): False [ 1001.435436] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.435436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.435436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.435436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.460536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.461645] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.461919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.462016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.462474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.462641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.463035] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.463175] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.463277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.463642] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.463769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.464129] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.464310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.464436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.464739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.464905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.465978] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e is going to be updated. [ 1001.538172] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.538387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.538463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.538716] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.538866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.557047] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e in Status: IN_PROGRESS for 2s [ 1001.602741] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.603050] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.603191] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.603572] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.603813] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.603941] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port fd6ce682-8144-43bd-9614-9f384f1f6d7b not found, creating... [ 1001.604323] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.604536] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.604668] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.605061] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.605200] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.605578] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.605804] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.605989] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.606377] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.606534] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.606732] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: fd6ce682-8144-43bd-9614-9f384f1f6d7b is going to be created. [ 1001.630826] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.631094] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.631229] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.631544] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.631791] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.632094] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-fd6ce682-8144-43bd-9614-9f384f1f6d7b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.115293] env[69343]: INFO networking_nsxv3.common.synchronization [None req-c38db513-0b4a-4590-ace9-09437c959ecb None None] Enqueued Resource ID: cb6d0003-4b21-432e-9aee-fb1b8f742463 with Priority: HIGHEST for action port [ 1002.115293] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb6d0003-4b21-432e-9aee-fb1b8f742463 with Priority: HIGHEST for action port [ 1002.115293] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb6d0003-4b21-432e-9aee-fb1b8f742463 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.115293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb6d0003-4b21-432e-9aee-fb1b8f742463" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.115982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb6d0003-4b21-432e-9aee-fb1b8f742463" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.116748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb6d0003-4b21-432e-9aee-fb1b8f742463" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.116950] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb6d0003-4b21-432e-9aee-fb1b8f742463',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.344281] env[69343]: INFO networking_nsxv3.common.synchronization [req-5a712ce0-ca7a-4a40-a792-ac59ea60b083 req-85ea6c94-1564-4280-a499-ed10145885f9 service nova] Enqueued Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_rules [ 1002.344281] env[69343]: INFO networking_nsxv3.common.synchronization [req-5a712ce0-ca7a-4a40-a792-ac59ea60b083 req-85ea6c94-1564-4280-a499-ed10145885f9 service nova] Enqueued Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1002.344281] env[69343]: INFO networking_nsxv3.common.synchronization [req-5a712ce0-ca7a-4a40-a792-ac59ea60b083 req-85ea6c94-1564-4280-a499-ed10145885f9 service nova] Enqueued Resource ID: fd6ce682-8144-43bd-9614-9f384f1f6d7b with Priority: HIGHEST for action port [ 1002.344281] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_rules [ 1002.344281] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1002.344281] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd6ce682-8144-43bd-9614-9f384f1f6d7b with Priority: HIGHEST for action port [ 1002.344281] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.344281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.344281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.344712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.344712] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.345403] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.345706] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.345790] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.346027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.346355] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.346500] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.346562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.346937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.347051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.349096] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.349096] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd6ce682-8144-43bd-9614-9f384f1f6d7b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.349096] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd6ce682-8144-43bd-9614-9f384f1f6d7b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.349096] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd6ce682-8144-43bd-9614-9f384f1f6d7b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.349096] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd6ce682-8144-43bd-9614-9f384f1f6d7b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.349096] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd6ce682-8144-43bd-9614-9f384f1f6d7b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.619508] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb6d0003-4b21-432e-9aee-fb1b8f742463 [ 1002.619749] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.619883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.619950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.620216] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.620365] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.620417] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb6d0003-4b21-432e-9aee-fb1b8f742463 already deleted. [ 1002.620499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb6d0003-4b21-432e-9aee-fb1b8f742463" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.852589] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.852589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.852589] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.854384] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd6ce682-8144-43bd-9614-9f384f1f6d7b with status ACTIVE [ 1002.854874] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.855159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.859247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.859247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.859247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.859247] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.859247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.859247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.859247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.859247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.859247] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.859247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.859247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.859247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.859247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.859247] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd6ce682-8144-43bd-9614-9f384f1f6d7b is going to be updated. [ 1002.910666] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.910760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.910834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.911076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.911223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.911383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd6ce682-8144-43bd-9614-9f384f1f6d7b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.204997] env[69343]: INFO networking_nsxv3.common.synchronization [req-f1aae758-9fe9-4621-89f3-51ad3d44095d req-4452d44a-a1b1-4763-90a0-689149404021 tempest-ServersV294TestFqdnHostnames-1416518199 tempest-ServersV294TestFqdnHostnames-1416518199-project-member] Enqueued Resource ID: fdbb645d-14e7-4764-8083-5c521a4adb8c with Priority: HIGHEST for action security_group_members [ 1003.205769] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbb645d-14e7-4764-8083-5c521a4adb8c with Priority: HIGHEST for action security_group_members [ 1003.205996] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdbb645d-14e7-4764-8083-5c521a4adb8c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.206143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.206202] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.206469] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.206632] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.206733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.206788] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.206940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.207036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.207129] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdbb645d-14e7-4764-8083-5c521a4adb8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.363630] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.536147] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-430 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.536147] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-430" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.536364] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-430" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.536586] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-430" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.536875] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.538911] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.538911] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.538911] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.539373] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.539414] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.539654] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.539798] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.540353] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.540530] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.540942] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.541310] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.565185] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.565650] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1003.565941] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.566259] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-430" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.566694] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-71ac0b5f-a501-4d74-b994-1c2e19a9731a taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.566990] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-71ac0b5f-a501-4d74-b994-1c2e19a9731a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.567237] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-71ac0b5f-a501-4d74-b994-1c2e19a9731a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.567746] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-71ac0b5f-a501-4d74-b994-1c2e19a9731a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.567917] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71ac0b5f-a501-4d74-b994-1c2e19a9731a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.573404] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e in Status: SUCCESS [ 1003.573404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.709451] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.709728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.709923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.709996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.710499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.710499] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.710499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.710499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.710830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.710830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.710830] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdbb645d-14e7-4764-8083-5c521a4adb8c already deleted. [ 1003.710959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.866060] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.866253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.866253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.866762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.866928] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.867124] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 is going to be created. [ 1003.900338] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.900569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.900622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.900860] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.901043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.912472] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: UNINITIALIZED for 2s [ 1004.071953] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.071953] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.071953] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.071953] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.072393] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.072393] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 71ac0b5f-a501-4d74-b994-1c2e19a9731a not found, creating... [ 1004.072612] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.072769] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.072888] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.073189] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.073379] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.073603] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.074086] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.074266] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.074532] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.074803] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.075107] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 71ac0b5f-a501-4d74-b994-1c2e19a9731a is going to be created. [ 1004.099996] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.100602] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.100810] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.101201] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.101499] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.101770] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-71ac0b5f-a501-4d74-b994-1c2e19a9731a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.579101] env[69343]: INFO networking_nsxv3.common.synchronization [None req-3915a627-0161-4d12-85ce-e2e17853d18c None None] Enqueued Resource ID: f56a6a91-5177-47fd-bad3-72acdd007606 with Priority: HIGHEST for action port [ 1004.579101] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f56a6a91-5177-47fd-bad3-72acdd007606 with Priority: HIGHEST for action port [ 1004.579196] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-f56a6a91-5177-47fd-bad3-72acdd007606 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.579287] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f56a6a91-5177-47fd-bad3-72acdd007606" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.580044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f56a6a91-5177-47fd-bad3-72acdd007606" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.580044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f56a6a91-5177-47fd-bad3-72acdd007606" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.580044] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f56a6a91-5177-47fd-bad3-72acdd007606',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.841048] env[69343]: INFO networking_nsxv3.common.synchronization [req-f1aae758-9fe9-4621-89f3-51ad3d44095d req-68ad6573-1508-408f-b416-0e150d9fb89f service nova] Enqueued Resource ID: fdbb645d-14e7-4764-8083-5c521a4adb8c with Priority: HIGHEST for action security_group_rules [ 1004.841368] env[69343]: INFO networking_nsxv3.common.synchronization [req-f1aae758-9fe9-4621-89f3-51ad3d44095d req-68ad6573-1508-408f-b416-0e150d9fb89f service nova] Enqueued Resource ID: fdbb645d-14e7-4764-8083-5c521a4adb8c with Priority: HIGHEST for action security_group_members [ 1004.841624] env[69343]: INFO networking_nsxv3.common.synchronization [req-f1aae758-9fe9-4621-89f3-51ad3d44095d req-68ad6573-1508-408f-b416-0e150d9fb89f service nova] Enqueued Resource ID: 71ac0b5f-a501-4d74-b994-1c2e19a9731a with Priority: HIGHEST for action port [ 1004.842351] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbb645d-14e7-4764-8083-5c521a4adb8c with Priority: HIGHEST for action security_group_rules [ 1004.842542] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbb645d-14e7-4764-8083-5c521a4adb8c with Priority: HIGHEST for action security_group_members [ 1004.842745] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71ac0b5f-a501-4d74-b994-1c2e19a9731a with Priority: HIGHEST for action port [ 1004.843226] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdbb645d-14e7-4764-8083-5c521a4adb8c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.843416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.843489] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.843746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.843882] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdbb645d-14e7-4764-8083-5c521a4adb8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.845245] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdbb645d-14e7-4764-8083-5c521a4adb8c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.845363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.845431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.845611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.845878] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.845878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.846045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.846150] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.846150] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.846230] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdbb645d-14e7-4764-8083-5c521a4adb8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.846977] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-71ac0b5f-a501-4d74-b994-1c2e19a9731a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.847262] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71ac0b5f-a501-4d74-b994-1c2e19a9731a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.847262] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71ac0b5f-a501-4d74-b994-1c2e19a9731a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.847339] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71ac0b5f-a501-4d74-b994-1c2e19a9731a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.847396] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71ac0b5f-a501-4d74-b994-1c2e19a9731a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.081633] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f56a6a91-5177-47fd-bad3-72acdd007606 [ 1005.081887] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.082032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.082097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.082341] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.082450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.082522] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f56a6a91-5177-47fd-bad3-72acdd007606 already deleted. [ 1005.082602] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f56a6a91-5177-47fd-bad3-72acdd007606" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.348866] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdbb645d-14e7-4764-8083-5c521a4adb8c taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.348997] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.350372] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdbb645d-14e7-4764-8083-5c521a4adb8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.351505] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71ac0b5f-a501-4d74-b994-1c2e19a9731a with status ACTIVE [ 1005.351505] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.351668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.351711] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.351926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.352076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.352314] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.352421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.352460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.352626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.352708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.352890] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.352986] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.353064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.353431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.353431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.353431] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71ac0b5f-a501-4d74-b994-1c2e19a9731a is going to be updated. [ 1005.374465] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.374712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.374712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.374994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.375124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.375714] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71ac0b5f-a501-4d74-b994-1c2e19a9731a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.855704] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdbb645d-14e7-4764-8083-5c521a4adb8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.922675] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: SUCCESS [ 1005.922891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.923074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.923308] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.923505] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.923652] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.923721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.923878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.923963] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.924084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.924296] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.358236] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.358442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.358518] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.358728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.358820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.358921] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdbb645d-14e7-4764-8083-5c521a4adb8c is going to be created. [ 1006.383831] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.384053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.384159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.384404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.384603] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.395043] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdbb645d-14e7-4764-8083-5c521a4adb8c in Status: UNINITIALIZED for 2s [ 1006.427474] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.427474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.427474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.427474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.427744] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.427744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.427744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.427899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.427933] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.428012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.428163] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.428251] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.428309] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.428446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.428575] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.428658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.428714] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.428846] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.428953] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.428996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.429079] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.931394] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8: rpc.has_security_group_logging(os_id): False [ 1006.950209] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.950595] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.950595] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.950710] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.950742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.950937] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.951045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.951110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.951257] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.951335] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.951529] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.951623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.951685] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.951822] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.951896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.952490] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.952490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.952490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.952490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.952490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.952726] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 is going to be created. [ 1007.018337] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.018486] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.018531] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.018747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.018923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.030576] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: IN_PROGRESS for 2s [ 1007.887682] env[69343]: INFO networking_nsxv3.common.synchronization [req-7aacf0f0-fa3f-49d6-9ff9-045ddb4069fd req-b3a32234-15ed-4f19-a308-5316886dc3ad tempest-ServerPasswordTestJSON-1295341542 tempest-ServerPasswordTestJSON-1295341542-project-member] Enqueued Resource ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 with Priority: HIGHEST for action security_group_members [ 1007.888369] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 with Priority: HIGHEST for action security_group_members [ 1007.888813] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-53614dab-3dfd-44ee-8ebe-f06847c53bb0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.888813] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.888944] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.889208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.889374] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.889476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.889598] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.889741] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.889828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.889941] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53614dab-3dfd-44ee-8ebe-f06847c53bb0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.200892] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.200892] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-151" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.200892] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-151" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.200892] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-151" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.200892] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.200892] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.200892] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.200892] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.202335] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.202612] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.202789] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.202915] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.203052] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.204035] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.204035] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.204035] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.222666] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.223933] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1008.223933] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.223933] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-151" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.223933] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-6628e29a-6810-4849-89e4-87ac9232630d taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.223933] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-6628e29a-6810-4849-89e4-87ac9232630d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.223933] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-6628e29a-6810-4849-89e4-87ac9232630d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.224287] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-6628e29a-6810-4849-89e4-87ac9232630d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.224512] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6628e29a-6810-4849-89e4-87ac9232630d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.395261] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.395423] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.395496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.395723] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.395898] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.396126] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.396231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.396276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.397411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.397588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.397639] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 already deleted. [ 1008.397684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.407103] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdbb645d-14e7-4764-8083-5c521a4adb8c in Status: SUCCESS [ 1008.407452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.407627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.407836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.408036] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.408396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.408396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.408396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.408905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.409052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.409157] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdbb645d-14e7-4764-8083-5c521a4adb8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.726596] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.726856] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.726989] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.727303] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.727516] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.727689] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 6628e29a-6810-4849-89e4-87ac9232630d not found, creating... [ 1008.727981] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.728575] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.728575] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.728678] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.728763] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.729260] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.729510] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.729728] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.730062] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.730294] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.730703] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 6628e29a-6810-4849-89e4-87ac9232630d is going to be created. [ 1008.751144] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.751649] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.751872] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.752754] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.753081] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.753396] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-6628e29a-6810-4849-89e4-87ac9232630d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.911595] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdbb645d-14e7-4764-8083-5c521a4adb8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.045982] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: SUCCESS [ 1009.045982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.414699] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdbb645d-14e7-4764-8083-5c521a4adb8c: rpc.has_security_group_logging(os_id): False [ 1009.436832] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.437046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.437168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.437797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.437797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.437954] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.438053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.438112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.438353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.438492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.438672] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdbb645d-14e7-4764-8083-5c521a4adb8c is going to be created. [ 1009.468059] env[69343]: INFO networking_nsxv3.common.synchronization [req-7aacf0f0-fa3f-49d6-9ff9-045ddb4069fd req-bc494a33-2855-489b-87ae-36c80e8a3abe service nova] Enqueued Resource ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 with Priority: HIGHEST for action security_group_rules [ 1009.468059] env[69343]: INFO networking_nsxv3.common.synchronization [req-7aacf0f0-fa3f-49d6-9ff9-045ddb4069fd req-bc494a33-2855-489b-87ae-36c80e8a3abe service nova] Enqueued Resource ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 with Priority: HIGHEST for action security_group_members [ 1009.468059] env[69343]: INFO networking_nsxv3.common.synchronization [req-7aacf0f0-fa3f-49d6-9ff9-045ddb4069fd req-bc494a33-2855-489b-87ae-36c80e8a3abe service nova] Enqueued Resource ID: 6628e29a-6810-4849-89e4-87ac9232630d with Priority: HIGHEST for action port [ 1009.468059] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 with Priority: HIGHEST for action security_group_rules [ 1009.468059] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 with Priority: HIGHEST for action security_group_members [ 1009.469275] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6628e29a-6810-4849-89e4-87ac9232630d with Priority: HIGHEST for action port [ 1009.470255] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53614dab-3dfd-44ee-8ebe-f06847c53bb0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.471301] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.471636] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.472305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.473566] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53614dab-3dfd-44ee-8ebe-f06847c53bb0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.474233] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-53614dab-3dfd-44ee-8ebe-f06847c53bb0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.474533] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.474701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.476390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.476390] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.476390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.478400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.478400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.478400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.478400] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53614dab-3dfd-44ee-8ebe-f06847c53bb0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.481029] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-6628e29a-6810-4849-89e4-87ac9232630d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.481029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6628e29a-6810-4849-89e4-87ac9232630d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.481029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6628e29a-6810-4849-89e4-87ac9232630d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.481029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6628e29a-6810-4849-89e4-87ac9232630d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.481029] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6628e29a-6810-4849-89e4-87ac9232630d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.534431] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.534431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.534431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.534431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.534431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.561326] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdbb645d-14e7-4764-8083-5c521a4adb8c in Status: IN_PROGRESS for 2s [ 1009.985098] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6628e29a-6810-4849-89e4-87ac9232630d with status ACTIVE [ 1009.985098] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.985098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.985302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.985451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.985451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.985777] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.985777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.985777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.985916] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.986010] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.986204] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.986299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.986355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.986496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.986609] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.986668] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6628e29a-6810-4849-89e4-87ac9232630d is going to be updated. [ 1009.987752] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('53614dab-3dfd-44ee-8ebe-f06847c53bb0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.992164] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-53614dab-3dfd-44ee-8ebe-f06847c53bb0 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.992354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.014648] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.014817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.014881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.015096] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.015237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.015494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6628e29a-6810-4849-89e4-87ac9232630d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.493998] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('53614dab-3dfd-44ee-8ebe-f06847c53bb0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.996697] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.996857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.996928] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.997335] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.997469] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.997599] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 is going to be created. [ 1011.022475] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.022687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.022725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.022933] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.023114] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.033015] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 in Status: UNINITIALIZED for 2s [ 1011.572971] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdbb645d-14e7-4764-8083-5c521a4adb8c in Status: SUCCESS [ 1011.573391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.805222] env[69343]: INFO networking_nsxv3.common.synchronization [req-5eb23e64-4e51-4b34-ad21-e1a44e83b7bf req-e0a4c04f-85df-4445-96ee-06dd725d4904 tempest-FloatingIPsAssociationTestJSON-927978617 tempest-FloatingIPsAssociationTestJSON-927978617-project-member] Enqueued Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGHEST for action security_group_members [ 1012.805788] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGHEST for action security_group_members [ 1012.806308] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.806446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.806517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.806717] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.806878] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.806970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.807058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.807192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.807276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.807368] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.054488] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 in Status: SUCCESS [ 1013.054662] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.054842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.055362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.055578] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.055703] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.055772] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.055937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.056036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.056118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.056211] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53614dab-3dfd-44ee-8ebe-f06847c53bb0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.247655] env[69343]: INFO networking_nsxv3.common.synchronization [req-aa076198-2d5c-4bf1-8b23-e535ac71453e req-99e5edf4-ae68-4aec-8541-d3cfda12a1ac tempest-ServersTestJSON-245111932 tempest-ServersTestJSON-245111932-project-member] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1013.251029] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1013.251029] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.251029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.251029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.251029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.251029] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.251029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.251029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.251029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.251029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.251480] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.302697] env[69343]: INFO networking_nsxv3.common.synchronization [req-457dcd04-fc0d-465c-8f72-39ecdff0b505 req-88aaf628-e797-4cf3-99fc-96f5ba95dfe9 tempest-AttachVolumeNegativeTest-1961671669 tempest-AttachVolumeNegativeTest-1961671669-project-member] Enqueued Resource ID: dec2bd26-cf02-479f-bf2c-2ca399054600 with Priority: HIGHEST for action security_group_members [ 1013.303980] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dec2bd26-cf02-479f-bf2c-2ca399054600 with Priority: HIGHEST for action security_group_members [ 1013.304414] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-dec2bd26-cf02-479f-bf2c-2ca399054600 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.304573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.304643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.304870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.305082] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.305191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.305255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.305439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.305550] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.305687] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dec2bd26-cf02-479f-bf2c-2ca399054600',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.309762] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.558401] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-53614dab-3dfd-44ee-8ebe-f06847c53bb0 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.558616] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.558679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.558900] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.559224] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.559391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.559463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.560373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.560567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.560734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.560952] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-53614dab-3dfd-44ee-8ebe-f06847c53bb0 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.561145] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.561254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.561456] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.561710] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.561884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.561960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.563984] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.564138] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.564322] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.564526] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53614dab-3dfd-44ee-8ebe-f06847c53bb0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.754497] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.809681] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.809958] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.809958] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.811592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.811592] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.835841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.835841] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.835841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.835841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.835841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.835841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.835841] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dec2bd26-cf02-479f-bf2c-2ca399054600 is going to be updated. [ 1013.860013] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.860169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.860244] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.860458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.860605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.873882] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dec2bd26-cf02-479f-bf2c-2ca399054600 in Status: IN_PROGRESS for 2s [ 1014.049603] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.049828] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.049958] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.050303] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.050585] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.050767] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.050904] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.051549] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.051721] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.052011] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1014.052492] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1014.052544] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1014.052642] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1014.052992] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1014.053130] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1014.053277] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.072779] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53614dab-3dfd-44ee-8ebe-f06847c53bb0: rpc.has_security_group_logging(os_id): False [ 1014.078680] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1014.078680] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1014.078915] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1014.079876] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.079876] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-e57ae396-d8d5-40be-8281-53b2be64cd77 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.079876] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-e57ae396-d8d5-40be-8281-53b2be64cd77" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.079876] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-e57ae396-d8d5-40be-8281-53b2be64cd77" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.080158] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-e57ae396-d8d5-40be-8281-53b2be64cd77" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.080327] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e57ae396-d8d5-40be-8281-53b2be64cd77',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.094451] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.094676] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.094758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.094973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.095085] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.095266] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.095361] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.095424] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.095580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.095661] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.095854] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.095946] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.096018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.096161] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.096235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.096419] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.096512] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.096728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.096728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.096832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.096919] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 is going to be created. [ 1014.161108] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.161281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.161404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.161650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.161860] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.174796] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 in Status: IN_PROGRESS for 2s [ 1014.258520] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.317036] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.317036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.317036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.317036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.317036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.317036] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e is going to be updated. [ 1014.358647] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.358846] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.358846] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.359144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.359257] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.370839] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e in Status: IN_PROGRESS for 2s [ 1014.587268] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.587268] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.587268] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.587268] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.587268] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.587268] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port e57ae396-d8d5-40be-8281-53b2be64cd77 not found, creating... [ 1014.587268] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.587268] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.587268] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.587268] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.587268] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.589047] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.589047] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.589242] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.589457] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.589645] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.589844] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: e57ae396-d8d5-40be-8281-53b2be64cd77 is going to be created. [ 1014.645632] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.646135] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.646135] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.646365] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.646666] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.646991] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-e57ae396-d8d5-40be-8281-53b2be64cd77" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.760362] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.760670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.760670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.760883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.760883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.760996] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1014.802174] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.802174] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.802174] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.802174] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.802453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.815774] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1015.435208] env[69343]: INFO networking_nsxv3.common.synchronization [req-aa076198-2d5c-4bf1-8b23-e535ac71453e req-e980c042-ac11-46c7-bb97-888c8efa3ea9 service nova] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_rules [ 1015.435427] env[69343]: INFO networking_nsxv3.common.synchronization [req-aa076198-2d5c-4bf1-8b23-e535ac71453e req-e980c042-ac11-46c7-bb97-888c8efa3ea9 service nova] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1015.435608] env[69343]: INFO networking_nsxv3.common.synchronization [req-aa076198-2d5c-4bf1-8b23-e535ac71453e req-e980c042-ac11-46c7-bb97-888c8efa3ea9 service nova] Enqueued Resource ID: e57ae396-d8d5-40be-8281-53b2be64cd77 with Priority: HIGHEST for action port [ 1015.436512] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_rules [ 1015.436661] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1015.436764] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e57ae396-d8d5-40be-8281-53b2be64cd77 with Priority: HIGHEST for action port [ 1015.437062] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.437210] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.437266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.437451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.437565] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.438759] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.438857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.439069] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-e57ae396-d8d5-40be-8281-53b2be64cd77 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.439181] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e57ae396-d8d5-40be-8281-53b2be64cd77" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.439242] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e57ae396-d8d5-40be-8281-53b2be64cd77" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.439396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e57ae396-d8d5-40be-8281-53b2be64cd77" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.443127] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e57ae396-d8d5-40be-8281-53b2be64cd77',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.883382] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dec2bd26-cf02-479f-bf2c-2ca399054600 in Status: SUCCESS [ 1015.883746] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dec2bd26-cf02-479f-bf2c-2ca399054600 deletion is rescheduled due to dependency. [ 1015.883746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.941402] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.941650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.945943] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e57ae396-d8d5-40be-8281-53b2be64cd77 with status ACTIVE [ 1015.946151] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.946299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.946362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.946641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.946705] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.946850] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.946946] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.947015] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.947175] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.947251] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.947428] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.947520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.947579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.947715] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.947842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.947876] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e57ae396-d8d5-40be-8281-53b2be64cd77 is going to be updated. [ 1015.968763] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.968979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.969041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.969318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.969503] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.969710] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e57ae396-d8d5-40be-8281-53b2be64cd77" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.187691] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 in Status: SUCCESS [ 1016.188108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.254758] env[69343]: INFO networking_nsxv3.common.synchronization [req-de23f195-2e97-4c9f-bafb-8f05dbfac687 req-ff564bff-c702-4263-b696-7a387d5acb7a tempest-ListServersNegativeTestJSON-1410805351 tempest-ListServersNegativeTestJSON-1410805351-project-member] Enqueued Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1016.254758] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1016.254758] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.254758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.255052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.258350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.258350] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.258350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.258350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.258350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.258350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.258350] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.384605] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e in Status: SUCCESS [ 1016.384865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.723707] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.723987] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-711" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.724120] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-711" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.724501] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-711" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.725112] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.725112] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.725112] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.725594] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.725594] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.725771] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.725916] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.726075] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.726182] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.726279] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.726371] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.726539] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.746646] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.746646] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1016.746646] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.746646] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-711" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.746853] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-8a5786d1-7bef-45ae-94b3-9b2a83ddd123 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.746853] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-8a5786d1-7bef-45ae-94b3-9b2a83ddd123" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.746973] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-8a5786d1-7bef-45ae-94b3-9b2a83ddd123" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.747350] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-8a5786d1-7bef-45ae-94b3-9b2a83ddd123" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.747544] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a5786d1-7bef-45ae-94b3-9b2a83ddd123',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.764234] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.764234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.764234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.764234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.764234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.764234] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.764234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.764234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.764234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.764234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.764234] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b70491af-3fc6-4261-a302-3d7d52606515 already deleted. [ 1016.764234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.826123] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1016.826339] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.826511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.826786] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.827074] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.827254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.827349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.827588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.827712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.827844] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.249530] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.249855] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.249896] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.250306] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.250498] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.250693] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 8a5786d1-7bef-45ae-94b3-9b2a83ddd123 not found, creating... [ 1017.250989] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.251246] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.251470] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.251745] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.251925] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.252345] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.252557] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.252694] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.252914] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.253071] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.253220] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 8a5786d1-7bef-45ae-94b3-9b2a83ddd123 is going to be created. [ 1017.275257] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.275458] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.275606] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.275896] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.276187] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.276437] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-8a5786d1-7bef-45ae-94b3-9b2a83ddd123" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.331540] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.717935] env[69343]: INFO networking_nsxv3.common.synchronization [req-302aac89-2a0b-47af-b395-b477d451abc7 req-bbccb1ee-065a-4102-a4ea-f22e82e2d825 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1017.718510] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1017.718828] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.718949] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.720330] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.720638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.720833] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.720973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.721075] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.721261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.721411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.721559] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.834216] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.224216] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.224639] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.224762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.225225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.225368] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.225709] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.225859] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.225945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.226140] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.226236] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.226329] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 already deleted. [ 1018.226434] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.270615] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.271049] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.271631] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.272626] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.272814] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.273451] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.275037] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.275037] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.275037] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.275037] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.275037] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.275037] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.275037] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.275443] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.275443] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.275509] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.279654] env[69343]: INFO networking_nsxv3.common.synchronization [req-de23f195-2e97-4c9f-bafb-8f05dbfac687 req-e46fce84-771b-40ce-a6f4-4dac5e9a115a service nova] Enqueued Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_rules [ 1018.281749] env[69343]: INFO networking_nsxv3.common.synchronization [req-de23f195-2e97-4c9f-bafb-8f05dbfac687 req-e46fce84-771b-40ce-a6f4-4dac5e9a115a service nova] Enqueued Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1018.281749] env[69343]: INFO networking_nsxv3.common.synchronization [req-de23f195-2e97-4c9f-bafb-8f05dbfac687 req-e46fce84-771b-40ce-a6f4-4dac5e9a115a service nova] Enqueued Resource ID: 8a5786d1-7bef-45ae-94b3-9b2a83ddd123 with Priority: HIGHEST for action port [ 1018.282575] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_rules [ 1018.282857] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1018.284297] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a5786d1-7bef-45ae-94b3-9b2a83ddd123 with Priority: HIGHEST for action port [ 1018.284297] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.284297] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.284297] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.284606] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.284606] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.286756] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.289611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.289611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.289611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.289611] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.289611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.289611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.289611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.289611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.289611] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.290266] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a5786d1-7bef-45ae-94b3-9b2a83ddd123 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.290453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a5786d1-7bef-45ae-94b3-9b2a83ddd123" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.290743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a5786d1-7bef-45ae-94b3-9b2a83ddd123" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.290979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a5786d1-7bef-45ae-94b3-9b2a83ddd123" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.291108] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a5786d1-7bef-45ae-94b3-9b2a83ddd123',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.297983] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.298208] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1018.298416] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.298699] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.299178] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-55648cfa-d71d-443f-acc6-4fcbd3011942 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.299464] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-55648cfa-d71d-443f-acc6-4fcbd3011942" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.299676] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-55648cfa-d71d-443f-acc6-4fcbd3011942" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.300136] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-55648cfa-d71d-443f-acc6-4fcbd3011942" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.300365] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55648cfa-d71d-443f-acc6-4fcbd3011942',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.336947] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.337124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.337232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.337499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.337599] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.337703] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1018.367474] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.367622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.367691] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.367888] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.368043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.392958] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1018.411207] env[69343]: INFO networking_nsxv3.common.synchronization [req-de23f195-2e97-4c9f-bafb-8f05dbfac687 req-65560a6c-6cc7-44ad-8576-74f3b907b456 tempest-ListServersNegativeTestJSON-1410805351 tempest-ListServersNegativeTestJSON-1410805351-project-member] Enqueued Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1018.411759] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1018.412069] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.412169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.751112] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.751337] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-711" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.751472] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-711" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.751747] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-711" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.752025] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.752188] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.752381] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.752623] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.752782] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.753213] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.753213] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.753362] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.753458] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.753578] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.753701] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.753819] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.774944] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.775239] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1018.775646] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.775646] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-711" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.775987] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-ede302d7-5ddd-4e39-9410-371b13137f85 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.776228] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-ede302d7-5ddd-4e39-9410-371b13137f85" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.776388] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-ede302d7-5ddd-4e39-9410-371b13137f85" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.777122] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-ede302d7-5ddd-4e39-9410-371b13137f85" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.777122] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ede302d7-5ddd-4e39-9410-371b13137f85',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.788215] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.788215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.791371] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.793058] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a5786d1-7bef-45ae-94b3-9b2a83ddd123 with status ACTIVE [ 1018.793535] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.793799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.793975] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.794329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.794533] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.794841] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.795086] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.795246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.797020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.797020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.797020] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.797020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.797020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.797020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.797020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.797020] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a5786d1-7bef-45ae-94b3-9b2a83ddd123 is going to be updated. [ 1018.804084] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.804214] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.804373] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.804672] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.804821] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.804978] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 55648cfa-d71d-443f-acc6-4fcbd3011942 not found, creating... [ 1018.805295] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.805522] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.805597] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.805819] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.805963] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.806263] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.806872] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.806872] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.806872] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.807028] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.807078] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 55648cfa-d71d-443f-acc6-4fcbd3011942 is going to be created. [ 1018.819508] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.819662] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.819713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.819906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.820053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.820310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a5786d1-7bef-45ae-94b3-9b2a83ddd123" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.828014] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.828014] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.828014] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.828189] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.828423] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.828648] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-55648cfa-d71d-443f-acc6-4fcbd3011942" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.280036] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.280438] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.280438] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.280688] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.280845] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.281049] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port ede302d7-5ddd-4e39-9410-371b13137f85 not found, creating... [ 1019.281340] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.281508] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.281632] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.281875] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.282034] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.282441] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.282610] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.282734] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.282960] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.283115] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.283318] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: ede302d7-5ddd-4e39-9410-371b13137f85 is going to be created. [ 1019.292541] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.307801] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.308059] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.308136] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.308462] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.308714] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.308984] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-ede302d7-5ddd-4e39-9410-371b13137f85" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.742899] env[69343]: INFO networking_nsxv3.common.synchronization [req-302aac89-2a0b-47af-b395-b477d451abc7 req-7a60a2f5-37a5-4ac3-a7a7-5cefdfe91841 service nova] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_rules [ 1019.743917] env[69343]: INFO networking_nsxv3.common.synchronization [req-302aac89-2a0b-47af-b395-b477d451abc7 req-7a60a2f5-37a5-4ac3-a7a7-5cefdfe91841 service nova] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1019.743917] env[69343]: INFO networking_nsxv3.common.synchronization [req-302aac89-2a0b-47af-b395-b477d451abc7 req-7a60a2f5-37a5-4ac3-a7a7-5cefdfe91841 service nova] Enqueued Resource ID: 55648cfa-d71d-443f-acc6-4fcbd3011942 with Priority: HIGHEST for action port [ 1019.744263] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_rules [ 1019.744400] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1019.744499] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55648cfa-d71d-443f-acc6-4fcbd3011942 with Priority: HIGHEST for action port [ 1019.744789] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.744890] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.744958] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.745232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.745328] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.746160] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.746617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.746617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.746617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.746759] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.746759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.746847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.746934] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.747209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.747330] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.748087] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-55648cfa-d71d-443f-acc6-4fcbd3011942 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.748198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55648cfa-d71d-443f-acc6-4fcbd3011942" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.748266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55648cfa-d71d-443f-acc6-4fcbd3011942" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.748707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55648cfa-d71d-443f-acc6-4fcbd3011942" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.748707] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55648cfa-d71d-443f-acc6-4fcbd3011942',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.795849] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.796694] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.796694] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.796694] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.796871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.796871] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b70491af-3fc6-4261-a302-3d7d52606515 is going to be created. [ 1019.823571] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.823857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.823857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.824010] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.824259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.834781] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: UNINITIALIZED for 2s [ 1019.961802] env[69343]: INFO networking_nsxv3.common.synchronization [req-b4faa2a0-a00b-4ec7-a406-fd628a406f03 req-41ab4865-150b-4671-946c-ddcb55b7caff tempest-ServerPasswordTestJSON-1295341542 tempest-ServerPasswordTestJSON-1295341542-project-member] Enqueued Resource ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 with Priority: HIGHEST for action security_group_members [ 1019.962649] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 with Priority: HIGHEST for action security_group_members [ 1019.963064] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-53614dab-3dfd-44ee-8ebe-f06847c53bb0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.963238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.963365] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.963611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.963857] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.964013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.964391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.964687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.964853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.965031] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53614dab-3dfd-44ee-8ebe-f06847c53bb0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.023407] env[69343]: INFO networking_nsxv3.common.synchronization [req-de23f195-2e97-4c9f-bafb-8f05dbfac687 req-77cba2e1-847b-4d12-a1ab-dff85bc3e705 service nova] Enqueued Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_rules [ 1020.023700] env[69343]: INFO networking_nsxv3.common.synchronization [req-de23f195-2e97-4c9f-bafb-8f05dbfac687 req-77cba2e1-847b-4d12-a1ab-dff85bc3e705 service nova] Enqueued Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1020.025056] env[69343]: INFO networking_nsxv3.common.synchronization [req-de23f195-2e97-4c9f-bafb-8f05dbfac687 req-77cba2e1-847b-4d12-a1ab-dff85bc3e705 service nova] Enqueued Resource ID: ede302d7-5ddd-4e39-9410-371b13137f85 with Priority: HIGHEST for action port [ 1020.025056] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_rules [ 1020.025228] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1020.025398] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ede302d7-5ddd-4e39-9410-371b13137f85 with Priority: HIGHEST for action port [ 1020.025820] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.025820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.026609] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.026790] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.027136] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-ede302d7-5ddd-4e39-9410-371b13137f85 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.027334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ede302d7-5ddd-4e39-9410-371b13137f85" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.027462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ede302d7-5ddd-4e39-9410-371b13137f85" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.027812] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ede302d7-5ddd-4e39-9410-371b13137f85" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.027980] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ede302d7-5ddd-4e39-9410-371b13137f85',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.250839] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.251178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.251368] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.252463] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55648cfa-d71d-443f-acc6-4fcbd3011942 with status ACTIVE [ 1020.252794] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.252962] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.252962] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.253225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.253430] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.253646] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.253769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.253826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.254060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.254160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.254355] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.254471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.254537] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.254792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.254844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.254942] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55648cfa-d71d-443f-acc6-4fcbd3011942 is going to be updated. [ 1020.284358] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.284759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.284759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.284918] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.285094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.285274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55648cfa-d71d-443f-acc6-4fcbd3011942" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.405638] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1020.405812] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.405953] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.406193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.406390] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.406538] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.406580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.406715] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.406814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.406881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.406971] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.470681] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.470914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.470964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.471186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.471315] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.471476] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.471569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.471627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.471779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.471855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.471943] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 is going to be updated. [ 1020.500806] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.501046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.501046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.501287] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.501435] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.511438] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 in Status: IN_PROGRESS for 2s [ 1020.531324] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ede302d7-5ddd-4e39-9410-371b13137f85 with status ACTIVE [ 1020.531609] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.531833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.531978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.532244] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.532414] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.532617] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.532760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.532866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.533307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.533307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.533429] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.533512] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.533569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.533731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.533824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.533925] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ede302d7-5ddd-4e39-9410-371b13137f85 is going to be updated. [ 1020.561305] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.561305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.561305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.561305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.561659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.561659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ede302d7-5ddd-4e39-9410-371b13137f85" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.757328] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.907173] env[69343]: INFO networking_nsxv3.common.synchronization [req-de23f195-2e97-4c9f-bafb-8f05dbfac687 req-1d367a6c-a203-4eda-bb2f-04d7f2171a7c tempest-ListServersNegativeTestJSON-1410805351 tempest-ListServersNegativeTestJSON-1410805351-project-member] Enqueued Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1020.907658] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1020.907955] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.908246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.908540] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.908661] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.908745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.908946] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.909113] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.909207] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.909270] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.909424] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.909506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.909625] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.909723] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.909809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.909866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.910354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.910498] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.910592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.910653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.910789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.910865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.910944] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.911041] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.265462] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.265462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.265462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.265462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.265462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.265462] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be created. [ 1021.307697] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.307697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.307697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.307697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.307697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.319272] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: UNINITIALIZED for 2s [ 1021.413677] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ff65ed7-3c36-4248-86bb-8bb20a53fde4: rpc.has_security_group_logging(os_id): False [ 1021.418244] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.418693] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-711" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.418943] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-711" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.419366] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-711" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.419772] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.421066] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.421066] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.421066] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.421066] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.421066] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1021.421477] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.421477] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.421477] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.421477] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1021.421628] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.421733] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.441890] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.442018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.442482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.442618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.442685] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.443104] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.443253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.443349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.443595] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.443777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.444304] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.444304] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.444304] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.444577] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.444577] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.444765] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.444889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.444953] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.445125] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.445228] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.445363] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1021.448241] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.448437] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1021.448646] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.448829] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-711" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.449171] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-a0632795-8a00-4b1d-ba9f-85f776aab59a taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.449373] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-a0632795-8a00-4b1d-ba9f-85f776aab59a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.449504] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-a0632795-8a00-4b1d-ba9f-85f776aab59a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.449847] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-a0632795-8a00-4b1d-ba9f-85f776aab59a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.450054] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0632795-8a00-4b1d-ba9f-85f776aab59a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.522106] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.522106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.522106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.522378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.522503] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.546393] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1021.850767] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: SUCCESS [ 1021.851058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.851246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.851479] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.851678] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.851798] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.851861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.852042] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.852227] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.852501] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.952989] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.953305] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.953956] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.953956] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.953956] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.954509] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port a0632795-8a00-4b1d-ba9f-85f776aab59a not found, creating... [ 1021.954509] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.954693] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.954761] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.954942] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.955103] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.955431] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.955816] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.955816] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.956023] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.956197] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.956366] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: a0632795-8a00-4b1d-ba9f-85f776aab59a is going to be created. [ 1021.976766] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.977069] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.977263] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.977577] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.977855] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.978124] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-a0632795-8a00-4b1d-ba9f-85f776aab59a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.355069] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.523847] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 in Status: SUCCESS [ 1022.524061] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53614dab-3dfd-44ee-8ebe-f06847c53bb0 deletion is rescheduled due to dependency. [ 1022.524177] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53614dab-3dfd-44ee-8ebe-f06847c53bb0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.857369] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.063903] env[69343]: INFO networking_nsxv3.common.synchronization [req-de23f195-2e97-4c9f-bafb-8f05dbfac687 req-7fbc6b7b-29ce-48f0-b76d-bf4269d80364 service nova] Enqueued Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_rules [ 1023.064184] env[69343]: INFO networking_nsxv3.common.synchronization [req-de23f195-2e97-4c9f-bafb-8f05dbfac687 req-7fbc6b7b-29ce-48f0-b76d-bf4269d80364 service nova] Enqueued Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1023.064433] env[69343]: INFO networking_nsxv3.common.synchronization [req-de23f195-2e97-4c9f-bafb-8f05dbfac687 req-7fbc6b7b-29ce-48f0-b76d-bf4269d80364 service nova] Enqueued Resource ID: a0632795-8a00-4b1d-ba9f-85f776aab59a with Priority: HIGHEST for action port [ 1023.064961] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_rules [ 1023.065121] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1023.065224] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0632795-8a00-4b1d-ba9f-85f776aab59a with Priority: HIGHEST for action port [ 1023.065511] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.065622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.065821] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.065917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.066099] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0632795-8a00-4b1d-ba9f-85f776aab59a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.066202] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0632795-8a00-4b1d-ba9f-85f776aab59a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.066309] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0632795-8a00-4b1d-ba9f-85f776aab59a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.066524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0632795-8a00-4b1d-ba9f-85f776aab59a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.066729] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0632795-8a00-4b1d-ba9f-85f776aab59a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.330051] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1023.330273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.330456] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.330683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.330920] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.331156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.331156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.331319] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.331419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.332019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.332019] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.365327] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.365653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.365653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.365872] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.366111] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.366244] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b70491af-3fc6-4261-a302-3d7d52606515 is going to be updated. [ 1023.410295] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.410531] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.410618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.410836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.411042] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.427242] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: IN_PROGRESS for 2s [ 1023.562715] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1023.563024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.569752] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0632795-8a00-4b1d-ba9f-85f776aab59a with status ACTIVE [ 1023.569964] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.570216] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.570283] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.570597] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.570721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.570924] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.571092] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.571193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.571452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.571562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.571787] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.571911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.571985] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.572197] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.572287] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.572473] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0632795-8a00-4b1d-ba9f-85f776aab59a is going to be updated. [ 1023.612363] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.612363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.612363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.612363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.612363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.612363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0632795-8a00-4b1d-ba9f-85f776aab59a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.834423] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.834696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.834802] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.835009] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.835202] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.835323] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.835375] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.835505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.835589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.835683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.835819] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.835909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.836027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.836191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.836341] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.836455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.836516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.836657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.836737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.836818] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.836906] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.340450] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e6e2d6-f175-4be9-be9a-bdb1208e0e04: rpc.has_security_group_logging(os_id): False [ 1024.360472] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.360684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.360846] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.361122] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.361275] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.361612] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.361781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.361894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.362142] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.362268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.362561] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.362699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.362794] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.362998] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.363177] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.363426] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.363577] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.363732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.363914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.364038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.364157] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be created. [ 1024.444742] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.445213] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.446116] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.446721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.446828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.466857] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: IN_PROGRESS for 2s [ 1025.437941] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: SUCCESS [ 1025.438209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.438387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.438729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.438962] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.439098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.439150] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.439320] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.439401] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.439490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.439589] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.440507] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.440673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.440847] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.440954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.441035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.441185] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.441265] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.441429] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.840173] env[69343]: INFO networking_nsxv3.common.synchronization [None req-1fb397cd-14c0-43c1-9b11-62b3a10f1321 tempest-AttachVolumeNegativeTest-1961671669 tempest-AttachVolumeNegativeTest-1961671669-project-member] Enqueued Resource ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f with Priority: HIGHEST for action security_group_rules [ 1025.840497] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f with Priority: HIGHEST for action security_group_rules [ 1025.840672] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.840795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.840861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.841275] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.841416] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.913210] env[69343]: INFO networking_nsxv3.common.synchronization [None req-61124338-17ea-443f-8545-3d2d6c56e5b1 tempest-AttachVolumeNegativeTest-1961671669 tempest-AttachVolumeNegativeTest-1961671669-project-member] Enqueued Resource ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f with Priority: HIGHEST for action security_group_rules [ 1025.913763] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f with Priority: HIGHEST for action security_group_rules [ 1025.914468] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.914663] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.946321] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.946321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.946321] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.366047] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.366047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.366047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.366401] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.366401] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.366496] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f already deleted. [ 1026.366560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.366724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.366888] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.366976] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.445839] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.481048] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1026.481290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.888534] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.888978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.888978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.888978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.889163] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.889213] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f already deleted. [ 1026.889261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.950534] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.950725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.950786] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.950968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.951071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.951174] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b70491af-3fc6-4261-a302-3d7d52606515 is going to be updated. [ 1026.988189] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.988433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.988433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.988696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.988797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.999125] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: IN_PROGRESS for 2s [ 1027.249119] env[69343]: INFO networking_nsxv3.common.synchronization [req-6d360b77-e9bc-4440-9e16-aa0e3e17621a req-3abb01e3-5ee1-43ca-bb93-3000529a6494 tempest-FloatingIPsAssociationTestJSON-927978617 tempest-FloatingIPsAssociationTestJSON-927978617-project-member] Enqueued Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGHEST for action security_group_members [ 1027.249119] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGHEST for action security_group_members [ 1027.249119] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.249119] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.249119] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.249586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.249765] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.249879] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.249945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.250166] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.250258] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.250407] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.753715] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.753899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.753995] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.754206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.754346] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.754546] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.754674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.754767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.754865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.754939] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.755039] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e is going to be updated. [ 1027.787923] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.788423] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.788423] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.788582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.788691] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.799330] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e in Status: IN_PROGRESS for 2s [ 1028.043424] env[69343]: INFO networking_nsxv3.common.synchronization [req-9ca5352a-3b4d-443a-ab51-92527b7862c6 req-2dd08d3d-9a27-4c38-86ac-879034de10fa tempest-ImagesOneServerNegativeTestJSON-7986261 tempest-ImagesOneServerNegativeTestJSON-7986261-project-member] Enqueued Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1028.043866] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1028.044212] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.044333] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.044394] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.044590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.044737] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.044827] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.044885] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.045053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.045136] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.045224] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.547079] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.547294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.547452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.547662] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.547785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.547989] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.548107] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.548170] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.548330] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.548409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.548497] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 is going to be updated. [ 1028.579723] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.579723] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.579723] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.579723] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.580046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.596748] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: IN_PROGRESS for 2s [ 1029.013508] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: SUCCESS [ 1029.013508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.013508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.013508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.013508] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.013508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.013508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.013508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.013508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.013508] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.206867] env[69343]: INFO networking_nsxv3.common.synchronization [req-25ec75d7-8bbf-4b21-a5a0-1c5e518816c8 req-5150835f-1f83-4007-bb7a-620cab28d06d tempest-ServersTestJSON-245111932 tempest-ServersTestJSON-245111932-project-member] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1029.210019] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1029.210019] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.210019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.210331] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.210693] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.211015] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.214541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.214541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.214541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.214541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.214541] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.516345] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.660493] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.660859] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.661147] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.661577] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.662214] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.662491] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.662854] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.662948] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.663132] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.663398] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.663605] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.663742] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.663909] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.664072] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.664279] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.664377] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.687706] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.687862] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1029.688192] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.688727] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.688954] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-59d65e0a-3af6-4967-8e62-66a2431de8e8 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.689516] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-59d65e0a-3af6-4967-8e62-66a2431de8e8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.689599] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-59d65e0a-3af6-4967-8e62-66a2431de8e8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.689995] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-59d65e0a-3af6-4967-8e62-66a2431de8e8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.690204] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59d65e0a-3af6-4967-8e62-66a2431de8e8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.715766] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.811987] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e in Status: SUCCESS [ 1029.813117] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e deletion is rescheduled due to dependency. [ 1029.813348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.019357] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.196685] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.197087] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.197319] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.197749] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.198030] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.198289] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 59d65e0a-3af6-4967-8e62-66a2431de8e8 not found, creating... [ 1030.198740] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.199018] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.199336] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.201033] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.201033] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.201033] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.202142] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.202142] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.203135] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.203135] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.203135] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 59d65e0a-3af6-4967-8e62-66a2431de8e8 is going to be created. [ 1030.219285] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.229633] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.229952] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.230163] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.230688] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.231078] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.231840] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-59d65e0a-3af6-4967-8e62-66a2431de8e8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.522201] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.522427] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.522491] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.522721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.522823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.522916] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b70491af-3fc6-4261-a302-3d7d52606515 is going to be updated. [ 1030.582940] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.582940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.582940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.583394] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.583394] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.593867] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: IN_PROGRESS for 2s [ 1030.610363] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: SUCCESS [ 1030.610363] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 deletion is rescheduled due to dependency. [ 1030.610363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.722869] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.726118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.726118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.726118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.726118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.726118] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1030.760029] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.760342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.760486] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.760765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.760976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.771225] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1031.244551] env[69343]: INFO networking_nsxv3.common.synchronization [req-25ec75d7-8bbf-4b21-a5a0-1c5e518816c8 req-5d6f410c-bf06-4771-ad61-f315fdcc90ec service nova] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_rules [ 1031.244551] env[69343]: INFO networking_nsxv3.common.synchronization [req-25ec75d7-8bbf-4b21-a5a0-1c5e518816c8 req-5d6f410c-bf06-4771-ad61-f315fdcc90ec service nova] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1031.244551] env[69343]: INFO networking_nsxv3.common.synchronization [req-25ec75d7-8bbf-4b21-a5a0-1c5e518816c8 req-5d6f410c-bf06-4771-ad61-f315fdcc90ec service nova] Enqueued Resource ID: 59d65e0a-3af6-4967-8e62-66a2431de8e8 with Priority: HIGHEST for action port [ 1031.244551] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_rules [ 1031.244551] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1031.245505] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59d65e0a-3af6-4967-8e62-66a2431de8e8 with Priority: HIGHEST for action port [ 1031.247510] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.247510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.247510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.248512] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.248512] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.249628] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.249781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.253936] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-59d65e0a-3af6-4967-8e62-66a2431de8e8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.253936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59d65e0a-3af6-4967-8e62-66a2431de8e8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.253936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59d65e0a-3af6-4967-8e62-66a2431de8e8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.254241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59d65e0a-3af6-4967-8e62-66a2431de8e8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.254388] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59d65e0a-3af6-4967-8e62-66a2431de8e8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.757534] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.757534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.758580] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59d65e0a-3af6-4967-8e62-66a2431de8e8 with status ACTIVE [ 1031.758580] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.758580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.758580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.759284] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.759284] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.759284] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.759511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.759511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.760746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.760746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.760746] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.760746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.760746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.760746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.760746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.760746] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59d65e0a-3af6-4967-8e62-66a2431de8e8 is going to be updated. [ 1031.785554] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.785554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.785554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.785833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.785833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.785958] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59d65e0a-3af6-4967-8e62-66a2431de8e8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.551312] env[69343]: INFO networking_nsxv3.common.synchronization [req-757e8afc-1cf3-48a2-917d-013d64c8ce80 req-43b10deb-f3ac-4647-b6e1-5408afcefd08 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1032.553613] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1032.554808] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.555130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.555481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.555904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.556907] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.560024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.560024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.560024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.560024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.560024] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.614489] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: SUCCESS [ 1032.615430] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.615430] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.615430] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.615430] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.615695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.615695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.615785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.615820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.615904] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.674571] env[69343]: INFO networking_nsxv3.common.synchronization [req-bce8a3cf-bfb8-4b7f-b152-4a84718e46b3 req-e32be08e-11a2-4b56-8a55-ddb3c032b5c0 tempest-AttachVolumeNegativeTest-1961671669 tempest-AttachVolumeNegativeTest-1961671669-project-member] Enqueued Resource ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f with Priority: HIGHEST for action security_group_members [ 1032.675201] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f with Priority: HIGHEST for action security_group_members [ 1032.675586] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.675688] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.675754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.676034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.676185] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.676282] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.676342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.676673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.676673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.676673] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.782871] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1032.783098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.783274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.783601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.783818] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.783928] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.783997] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.784183] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.784269] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.784374] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.008621] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-837 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.008840] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-837" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.009017] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-837" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.009306] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-837" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.009576] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.009725] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.009855] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.010257] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.010477] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.010712] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1033.010834] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1033.010945] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1033.011079] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1033.011196] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1033.011305] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1033.011442] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1033.035033] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1033.035033] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1033.035191] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1033.035453] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-837" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.035791] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-7451c2a2-d8d0-4ed8-9f40-b5881626b6c7 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.035988] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-7451c2a2-d8d0-4ed8-9f40-b5881626b6c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.036154] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-7451c2a2-d8d0-4ed8-9f40-b5881626b6c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.036510] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-7451c2a2-d8d0-4ed8-9f40-b5881626b6c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.036670] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7451c2a2-d8d0-4ed8-9f40-b5881626b6c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.062838] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.062997] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.063081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.063326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.063409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.063590] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.063690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.063749] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.063899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.063975] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.064074] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be updated. [ 1033.105400] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.105875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.105875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.105989] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.107735] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.115919] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: IN_PROGRESS for 2s [ 1033.118734] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.181835] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.181835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.181835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.181835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.181835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.181835] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.181835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.181835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.181835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.181835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.181835] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f already deleted. [ 1033.181835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.286997] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.539368] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.539511] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.539588] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.539900] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.540061] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.540235] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 7451c2a2-d8d0-4ed8-9f40-b5881626b6c7 not found, creating... [ 1033.540559] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.540752] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.540858] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.541134] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.541285] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.541592] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.541752] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.542600] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.542600] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.542600] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.542600] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 7451c2a2-d8d0-4ed8-9f40-b5881626b6c7 is going to be created. [ 1033.577531] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.578044] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.578241] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.578784] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.579198] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.579653] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-7451c2a2-d8d0-4ed8-9f40-b5881626b6c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.621523] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.790191] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.127919] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.127919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.127919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.127919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.127919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.127919] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b70491af-3fc6-4261-a302-3d7d52606515 is going to be updated. [ 1034.175773] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.175773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.175773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.175773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.175773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.185508] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: IN_PROGRESS for 2s [ 1034.293384] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.296330] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.296330] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.296330] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.296330] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.296330] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1034.402238] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.402238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.402238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.402238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.402238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.414929] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1034.746694] env[69343]: INFO networking_nsxv3.common.synchronization [req-747bd0f5-a61c-4323-afc4-b357fc857a14 req-a7b18232-7154-4854-9015-962b4553c005 tempest-ListServersNegativeTestJSON-1410805351 tempest-ListServersNegativeTestJSON-1410805351-project-member] Enqueued Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1034.747633] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1034.748050] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.748224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.803080] env[69343]: INFO networking_nsxv3.common.synchronization [req-bce8a3cf-bfb8-4b7f-b152-4a84718e46b3 req-2b0f0636-fa1d-4383-8eed-dc8c7e57adf1 service nova] Enqueued Resource ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f with Priority: HIGHEST for action security_group_rules [ 1034.803286] env[69343]: INFO networking_nsxv3.common.synchronization [req-bce8a3cf-bfb8-4b7f-b152-4a84718e46b3 req-2b0f0636-fa1d-4383-8eed-dc8c7e57adf1 service nova] Enqueued Resource ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f with Priority: HIGHEST for action security_group_members [ 1034.803487] env[69343]: INFO networking_nsxv3.common.synchronization [req-bce8a3cf-bfb8-4b7f-b152-4a84718e46b3 req-2b0f0636-fa1d-4383-8eed-dc8c7e57adf1 service nova] Enqueued Resource ID: 7451c2a2-d8d0-4ed8-9f40-b5881626b6c7 with Priority: HIGHEST for action port [ 1034.803969] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f with Priority: HIGHEST for action security_group_rules [ 1034.804125] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f with Priority: HIGHEST for action security_group_members [ 1034.804209] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7451c2a2-d8d0-4ed8-9f40-b5881626b6c7 with Priority: HIGHEST for action port [ 1034.804481] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.804594] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.804656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.807614] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.807797] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.810824] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.811105] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.811257] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.812912] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.812912] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.812912] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.812912] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.815022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.815256] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.816379] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.818420] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-7451c2a2-d8d0-4ed8-9f40-b5881626b6c7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.818420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7451c2a2-d8d0-4ed8-9f40-b5881626b6c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.818420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7451c2a2-d8d0-4ed8-9f40-b5881626b6c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.818420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7451c2a2-d8d0-4ed8-9f40-b5881626b6c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.818420] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7451c2a2-d8d0-4ed8-9f40-b5881626b6c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.827629] env[69343]: INFO networking_nsxv3.common.synchronization [req-bfbd9cff-92a5-4eef-b8b6-8e4d8d296ff9 req-21dbd9af-d2c7-45c9-a3f2-8b8c396afb0e tempest-ServerActionsTestJSON-1397784852 tempest-ServerActionsTestJSON-1397784852-project-member] Enqueued Resource ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 with Priority: HIGHEST for action security_group_members [ 1034.830237] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 with Priority: HIGHEST for action security_group_members [ 1034.830237] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.830237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.830237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.830652] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.831656] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.831656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.831656] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.831937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.832350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.832580] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.126563] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1035.126742] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 deletion is rescheduled due to dependency. [ 1035.126863] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.235604] env[69343]: INFO networking_nsxv3.common.synchronization [req-4e766626-9b6d-4440-9a61-da24e6f5729c req-91cd5352-c3ca-4ef6-bc97-ab9db10d6e72 tempest-ServerActionsTestOtherA-678333832 tempest-ServerActionsTestOtherA-678333832-project-member] Enqueued Resource ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d with Priority: HIGHEST for action security_group_members [ 1035.236349] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d with Priority: HIGHEST for action security_group_members [ 1035.236702] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.237774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.237774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.237774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.237774] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.237774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.237774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.237774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.238054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.238054] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f4a1283-038d-4b9a-8c1a-7e43a4c6645d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.324505] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.324505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.324505] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.324505] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7451c2a2-d8d0-4ed8-9f40-b5881626b6c7 with status ACTIVE [ 1035.324505] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.324505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.324505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.324505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.324505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.324505] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.324505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.324505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.324505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.324505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.325132] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.325132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.325132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.325132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.325132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.325132] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7451c2a2-d8d0-4ed8-9f40-b5881626b6c7 is going to be updated. [ 1035.337728] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.337728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.337888] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.340563] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.363611] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.363816] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.363924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.364249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.364450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.364743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7451c2a2-d8d0-4ed8-9f40-b5881626b6c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.367591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.367591] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.367762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.367800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.369584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.369584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.369584] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 is going to be updated. [ 1035.412169] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.412169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.412169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.412169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.412169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.427157] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 in Status: IN_PROGRESS for 2s [ 1035.741439] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.741439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.741439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.741667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.765605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.765892] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.766025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.766118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.766356] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.766474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.766580] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d is going to be updated. [ 1035.801769] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.802492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.802613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.802826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.803033] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.816712] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d in Status: IN_PROGRESS for 2s [ 1035.829220] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.068068] env[69343]: INFO networking_nsxv3.common.synchronization [req-3609923e-ed9b-40b8-9af7-9b1abba04196 req-5b258ab9-acb7-413d-ac76-cc809475925a tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 6aff3244-8376-4f32-8e71-5312a77febc9 with Priority: HIGHEST for action security_group_members [ 1036.068279] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aff3244-8376-4f32-8e71-5312a77febc9 with Priority: HIGHEST for action security_group_members [ 1036.068803] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6aff3244-8376-4f32-8e71-5312a77febc9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.068971] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.069064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.069272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.070036] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.070036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.070036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.070036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.070246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.070307] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6aff3244-8376-4f32-8e71-5312a77febc9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.253217] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: SUCCESS [ 1036.253470] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.253669] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.253893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.254179] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.254331] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.254428] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.254540] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.254664] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.254733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.254939] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.255061] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.255108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.255524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.255524] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.255524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.255524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.255753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.255753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.255753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.255895] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.256730] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.256899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.257066] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.257168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.257233] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.257376] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.257496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.257593] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.330650] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.331081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.331081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.331188] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.331242] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.332155] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f is going to be created. [ 1036.360212] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.360575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.360575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.360771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.360873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.372586] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f in Status: UNINITIALIZED for 2s [ 1036.425763] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1036.425763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.425763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.425763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.425763] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.425763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.425763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.425763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.425763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.425763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.425763] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.574601] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.575225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.575722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.577477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.603887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.604021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.604118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.604180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.604385] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.604487] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.604584] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6aff3244-8376-4f32-8e71-5312a77febc9 is going to be updated. [ 1036.683128] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.684709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.684709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.684709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.684709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.711982] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6aff3244-8376-4f32-8e71-5312a77febc9 in Status: IN_PROGRESS for 2s [ 1036.760194] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b70491af-3fc6-4261-a302-3d7d52606515: rpc.has_security_group_logging(os_id): False [ 1036.761139] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.782157] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.782617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.782617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.782617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.782733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.782902] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.783023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.783083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.783205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.783283] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.783497] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.783667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.783667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.783853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.783853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.784083] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.784221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.784221] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.784380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.784458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.784583] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b70491af-3fc6-4261-a302-3d7d52606515 is going to be created. [ 1036.850295] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.850552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.850552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.850800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.851044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.863285] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: IN_PROGRESS for 2s [ 1036.934906] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.935178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.935257] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.935707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.935856] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.935940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.936039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.936277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.936413] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.936547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.936773] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.936889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.937096] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.937260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.937459] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.938284] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.938403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.938957] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.938957] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.938957] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.938957] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.264635] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.438029] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 in Status: SUCCESS [ 1037.438029] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 deletion is rescheduled due to dependency. [ 1037.438029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.443780] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ff65ed7-3c36-4248-86bb-8bb20a53fde4: rpc.has_security_group_logging(os_id): False [ 1037.463350] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.463585] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.463655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.463865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.463984] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.464195] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.464288] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.464352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.464508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.464618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.464811] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.464907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.464955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.465112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.465186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.465362] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.465453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.465508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.465647] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.465720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.465804] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1037.527028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.527028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.527028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.527028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.527028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.541408] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1037.768534] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.768640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.768717] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.768942] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.769049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.769161] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b70491af-3fc6-4261-a302-3d7d52606515 is going to be updated. [ 1037.800022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.800403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.800403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.800511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.800660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.809927] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: IN_PROGRESS for 2s [ 1037.827459] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d in Status: SUCCESS [ 1037.827645] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f4a1283-038d-4b9a-8c1a-7e43a4c6645d deletion is rescheduled due to dependency. [ 1037.827794] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f4a1283-038d-4b9a-8c1a-7e43a4c6645d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.387043] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f in Status: SUCCESS [ 1038.387043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.387260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.387441] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.387714] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.387847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.387955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.388496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.388496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.388496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.388496] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.723179] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6aff3244-8376-4f32-8e71-5312a77febc9 in Status: SUCCESS [ 1038.723402] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6aff3244-8376-4f32-8e71-5312a77febc9 deletion is rescheduled due to dependency. [ 1038.723548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.876731] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: SUCCESS [ 1038.877139] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.877508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.877508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.877508] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.892612] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.895246] env[69343]: INFO networking_nsxv3.common.synchronization [None req-1982cd90-2ba7-4dbc-a24a-cc52a73decb3 tempest-ImagesOneServerNegativeTestJSON-7986261 tempest-ImagesOneServerNegativeTestJSON-7986261-project-member] Enqueued Resource ID: 396f24b7-040b-4562-96fc-a25891b6775a with Priority: HIGHEST for action security_group_rules [ 1038.897235] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 396f24b7-040b-4562-96fc-a25891b6775a with Priority: HIGHEST for action security_group_rules [ 1038.897866] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-396f24b7-040b-4562-96fc-a25891b6775a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.898108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-396f24b7-040b-4562-96fc-a25891b6775a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.898235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-396f24b7-040b-4562-96fc-a25891b6775a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.898547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-396f24b7-040b-4562-96fc-a25891b6775a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.898690] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('396f24b7-040b-4562-96fc-a25891b6775a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.977349] env[69343]: INFO networking_nsxv3.common.synchronization [None req-3c490f5c-bd6c-4e7a-832d-4a295e8eebaf tempest-ImagesOneServerNegativeTestJSON-7986261 tempest-ImagesOneServerNegativeTestJSON-7986261-project-member] Enqueued Resource ID: 396f24b7-040b-4562-96fc-a25891b6775a with Priority: HIGHEST for action security_group_rules [ 1038.977894] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 396f24b7-040b-4562-96fc-a25891b6775a with Priority: HIGHEST for action security_group_rules [ 1038.978434] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-396f24b7-040b-4562-96fc-a25891b6775a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.978565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-396f24b7-040b-4562-96fc-a25891b6775a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.113501] env[69343]: INFO networking_nsxv3.common.synchronization [req-aed43c0d-f6a9-4990-8d2d-c680218e717b req-dc70658b-c947-41c8-a235-f38fb9a77b13 tempest-ServerDiskConfigTestJSON-1018188129 tempest-ServerDiskConfigTestJSON-1018188129-project-member] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 1039.114076] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 1039.114402] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.114526] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.114620] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.114903] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.115083] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.115187] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.115250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.115406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.115492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.115586] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.383376] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.383593] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.396945] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f: rpc.has_security_group_logging(os_id): False [ 1039.414856] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.414997] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.415081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.415294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.415385] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.415541] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 396f24b7-040b-4562-96fc-a25891b6775a already deleted. [ 1039.415668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-396f24b7-040b-4562-96fc-a25891b6775a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.415822] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-396f24b7-040b-4562-96fc-a25891b6775a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.415976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-396f24b7-040b-4562-96fc-a25891b6775a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.416078] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('396f24b7-040b-4562-96fc-a25891b6775a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.418119] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.418293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.418367] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.418552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.418629] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.418857] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.418958] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.419038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.419165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.419251] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.419406] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f is going to be created. [ 1039.483624] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.483844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.483844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.484437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.484437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.514180] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f in Status: IN_PROGRESS for 2s [ 1039.584812] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1039.585390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.618748] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.618927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.619012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.619260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.619361] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.619595] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.619715] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.619781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.619934] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.620019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.620110] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 1039.660560] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.660754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.660823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.661085] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.661268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.676452] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 1039.821194] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: SUCCESS [ 1039.821431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.821619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.821847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.821988] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.822122] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.822185] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.822350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.822436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.822587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.822685] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.940197] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.940586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.940586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.940669] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.940753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.940856] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 396f24b7-040b-4562-96fc-a25891b6775a already deleted. [ 1039.940944] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-396f24b7-040b-4562-96fc-a25891b6775a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.325106] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.325274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.325404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.325679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.325884] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.326018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.326113] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.326289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.326380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.326470] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.326616] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.326707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.326764] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.326902] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.327047] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.327136] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.327193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.327328] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.327403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.327484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.327574] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.829432] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b70491af-3fc6-4261-a302-3d7d52606515: rpc.has_security_group_logging(os_id): False [ 1040.850162] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.850162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.850162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.850506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.850506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.850650] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.850711] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.850982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.850982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.851223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.851223] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.851321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.851360] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.851492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.851569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.851758] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.851889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.852240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.852419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.852533] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.852627] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b70491af-3fc6-4261-a302-3d7d52606515 is going to be updated. [ 1040.916512] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.916707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.916758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.918325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.918325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.937709] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: IN_PROGRESS for 2s [ 1041.529754] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f in Status: SUCCESS [ 1041.530054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.688211] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 1041.689022] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b deletion is rescheduled due to dependency. [ 1041.689022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.952799] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: SUCCESS [ 1042.953185] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.953264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.953502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.953624] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.131124] env[69343]: INFO networking_nsxv3.common.synchronization [req-76a7c88e-7485-47ed-9fba-cd34ac95a29c req-1594c108-76bd-490f-8787-8080d520fc8d tempest-ServersTestJSON-245111932 tempest-ServersTestJSON-245111932-project-member] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1043.131124] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1043.131124] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.131475] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.131475] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.132510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.132510] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.132510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.132510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.132510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.132510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.132510] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.456609] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.456783] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.456857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.457089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.457274] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.457367] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.457423] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.457582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.457703] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.457807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.457900] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.634592] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.960546] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.960928] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.960928] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.961207] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.961408] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.961528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.961598] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.961764] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.961856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.961948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.962118] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.962217] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.962280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.962430] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.962749] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.962871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.962942] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.963133] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.963210] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.963301] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.963396] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.137441] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.465720] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b70491af-3fc6-4261-a302-3d7d52606515: rpc.has_security_group_logging(os_id): False [ 1044.484357] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.484582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.484582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.484808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.484939] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.485163] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.485271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.485449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.485516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.485661] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.486045] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.486045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.486180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.486280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.486318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.486497] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.486586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.486639] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.486783] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.486843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.486932] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b70491af-3fc6-4261-a302-3d7d52606515 is going to be updated. [ 1044.565182] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.565432] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.565432] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.565730] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.565921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.580281] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: IN_PROGRESS for 2s [ 1044.640232] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.640435] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.640516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.640747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.640842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.640947] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1044.696217] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.696399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.696441] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.696674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.696835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.724369] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1046.197049] env[69343]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1046.197324] env[69343]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1046.600208] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: SUCCESS [ 1046.600482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.736145] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1046.736398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.900498] env[69343]: INFO networking_nsxv3.common.synchronization [req-930c65d7-d446-4507-8ace-2211227df457 req-c0ef3d3b-47b0-4ef0-bb2a-44fc4ec286f8 tempest-ListServersNegativeTestJSON-1410805351 tempest-ListServersNegativeTestJSON-1410805351-project-member] Enqueued Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1047.901677] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1047.902051] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.902191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.902256] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.902459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.902638] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.902743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.902801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.902982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.903822] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.903938] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.968988] env[69343]: INFO networking_nsxv3.common.synchronization [req-ebe02afc-28b5-4a13-9a8c-d97895837bd7 req-58762f3a-a24e-4e4d-b9aa-bdded59f8709 tempest-ListServersNegativeTestJSON-1410805351 tempest-ListServersNegativeTestJSON-1410805351-project-member] Enqueued Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1047.969190] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGHEST for action security_group_members [ 1047.969623] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.969623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.407171] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.909865] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.412490] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.412831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.412831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.412990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.413118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.413219] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b70491af-3fc6-4261-a302-3d7d52606515 is going to be updated. [ 1049.442209] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.442353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.442425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.442695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.442837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.451987] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: IN_PROGRESS for 2s [ 1051.465759] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: SUCCESS [ 1051.466105] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.466173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.466380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.466690] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.466690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.466842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.466903] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.467381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.467381] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.863900] env[69343]: INFO networking_nsxv3.common.synchronization [None req-7459cbee-7eae-4605-ba53-cfcc7b47dbf7 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: d8742911-68ce-4e04-af8f-97f736173e2f with Priority: HIGHEST for action security_group_rules [ 1051.864465] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8742911-68ce-4e04-af8f-97f736173e2f with Priority: HIGHEST for action security_group_rules [ 1051.864781] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8742911-68ce-4e04-af8f-97f736173e2f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.864909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.864971] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.865206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.865291] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8742911-68ce-4e04-af8f-97f736173e2f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.944621] env[69343]: INFO networking_nsxv3.common.synchronization [None req-298986ae-1f4d-4fec-b58c-dde245849239 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: d8742911-68ce-4e04-af8f-97f736173e2f with Priority: HIGHEST for action security_group_rules [ 1051.944621] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8742911-68ce-4e04-af8f-97f736173e2f with Priority: HIGHEST for action security_group_rules [ 1051.944806] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8742911-68ce-4e04-af8f-97f736173e2f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.944806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.969903] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.970357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.970414] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.970621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.970706] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.970925] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.971045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.971103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.971257] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.971336] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.971424] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b70491af-3fc6-4261-a302-3d7d52606515 is going to be updated. [ 1052.002796] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.002974] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.003062] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.003283] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.003437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.012790] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: IN_PROGRESS for 2s [ 1052.387725] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.387920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.388030] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.388277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.388405] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.388648] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8742911-68ce-4e04-af8f-97f736173e2f already deleted. [ 1052.388769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.389997] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.389997] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.389997] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8742911-68ce-4e04-af8f-97f736173e2f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.911063] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.911649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.911649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.911649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.911649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.911649] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8742911-68ce-4e04-af8f-97f736173e2f already deleted. [ 1052.911862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.023333] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b70491af-3fc6-4261-a302-3d7d52606515 in Status: SUCCESS [ 1054.023654] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b70491af-3fc6-4261-a302-3d7d52606515 deletion is rescheduled due to dependency. [ 1054.024750] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.704456] env[69343]: INFO networking_nsxv3.common.synchronization [req-538c0401-d1c2-42a9-8563-4332329996c7 req-92b16865-fa18-4264-bb03-040a241abf31 tempest-ServersV294TestFqdnHostnames-1416518199 tempest-ServersV294TestFqdnHostnames-1416518199-project-member] Enqueued Resource ID: fdbb645d-14e7-4764-8083-5c521a4adb8c with Priority: HIGHEST for action security_group_members [ 1054.705031] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbb645d-14e7-4764-8083-5c521a4adb8c with Priority: HIGHEST for action security_group_members [ 1054.705444] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdbb645d-14e7-4764-8083-5c521a4adb8c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.706106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.706106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.706106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.706268] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.706332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.706440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.706580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.706669] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.706760] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdbb645d-14e7-4764-8083-5c521a4adb8c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.210607] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.210607] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.210607] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.211126] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.211126] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.211126] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.211126] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.211576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.211576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.211576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.211576] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdbb645d-14e7-4764-8083-5c521a4adb8c is going to be updated. [ 1055.243397] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.243685] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.243685] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.243908] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.244106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.255303] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdbb645d-14e7-4764-8083-5c521a4adb8c in Status: IN_PROGRESS for 2s [ 1055.902249] env[69343]: INFO networking_nsxv3.common.synchronization [req-7c8bca7f-b6a5-4606-b08a-cc9963ee0fd5 req-1c200695-03ea-4c5d-9dc2-d93ebe772677 tempest-ServerDiskConfigTestJSON-1018188129 tempest-ServerDiskConfigTestJSON-1018188129-project-member] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 1055.902944] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 1055.903405] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.903581] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.903635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.903902] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.904187] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.904322] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.904450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.904697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.904851] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.904992] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.185996] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.185996] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.185996] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.185996] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.186290] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.186367] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.186549] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.186767] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.186993] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.187215] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.187375] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.187626] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.187661] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.187868] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.187931] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.188255] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.208379] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.208468] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1056.208635] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.208907] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-842" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.209937] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-e1ff1ad2-8f26-4818-9704-602507f79a21 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.209937] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-e1ff1ad2-8f26-4818-9704-602507f79a21" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.209937] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-e1ff1ad2-8f26-4818-9704-602507f79a21" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.209937] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-e1ff1ad2-8f26-4818-9704-602507f79a21" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.210232] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1ff1ad2-8f26-4818-9704-602507f79a21',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.408654] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.409064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.409064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.409195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.409293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.409521] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.409649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.409718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.409905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.409992] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.410106] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 1056.439732] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.439954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.440015] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.440255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.440440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.449457] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 1056.712970] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.713447] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.713667] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.714092] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.714335] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.714576] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port e1ff1ad2-8f26-4818-9704-602507f79a21 not found, creating... [ 1056.714989] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.715260] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.715455] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.715799] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.716216] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.716665] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.716908] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.717103] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.717404] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.717607] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.717809] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: e1ff1ad2-8f26-4818-9704-602507f79a21 is going to be created. [ 1056.742877] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.743149] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.743294] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.743584] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.743885] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.744859] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-e1ff1ad2-8f26-4818-9704-602507f79a21" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.266266] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdbb645d-14e7-4764-8083-5c521a4adb8c in Status: SUCCESS [ 1057.266387] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdbb645d-14e7-4764-8083-5c521a4adb8c deletion is rescheduled due to dependency. [ 1057.266502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdbb645d-14e7-4764-8083-5c521a4adb8c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.439322] env[69343]: INFO networking_nsxv3.common.synchronization [req-7c8bca7f-b6a5-4606-b08a-cc9963ee0fd5 req-4d8e17ae-9d2a-48af-9fa9-f6c5b5b2b496 service nova] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_rules [ 1057.439322] env[69343]: INFO networking_nsxv3.common.synchronization [req-7c8bca7f-b6a5-4606-b08a-cc9963ee0fd5 req-4d8e17ae-9d2a-48af-9fa9-f6c5b5b2b496 service nova] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 1057.439322] env[69343]: INFO networking_nsxv3.common.synchronization [req-7c8bca7f-b6a5-4606-b08a-cc9963ee0fd5 req-4d8e17ae-9d2a-48af-9fa9-f6c5b5b2b496 service nova] Enqueued Resource ID: e1ff1ad2-8f26-4818-9704-602507f79a21 with Priority: HIGHEST for action port [ 1057.439322] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_rules [ 1057.439322] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 1057.439322] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1ff1ad2-8f26-4818-9704-602507f79a21 with Priority: HIGHEST for action port [ 1057.439322] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.440405] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.440617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.441324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.441534] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.443227] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.444729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.444729] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1ff1ad2-8f26-4818-9704-602507f79a21 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.444729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1ff1ad2-8f26-4818-9704-602507f79a21" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.444729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1ff1ad2-8f26-4818-9704-602507f79a21" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.444729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1ff1ad2-8f26-4818-9704-602507f79a21" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.444729] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1ff1ad2-8f26-4818-9704-602507f79a21',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.947657] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.947844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.947964] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1ff1ad2-8f26-4818-9704-602507f79a21 with status ACTIVE [ 1057.948140] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.948248] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.948306] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.948525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.948614] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.948803] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.948920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.948990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.949175] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.949258] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.949442] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.949538] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.949596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.949740] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.949815] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.949902] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1ff1ad2-8f26-4818-9704-602507f79a21 is going to be updated. [ 1057.972883] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.973037] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.973156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.973324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.973467] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.973696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1ff1ad2-8f26-4818-9704-602507f79a21" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.342829] env[69343]: INFO networking_nsxv3.common.synchronization [req-0d69a627-3d32-4bd4-b554-1f469517cf23 req-5ed12745-6bc0-40c4-9fb7-97916c05aaee tempest-ImagesOneServerNegativeTestJSON-7986261 tempest-ImagesOneServerNegativeTestJSON-7986261-project-member] Enqueued Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1058.343442] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1058.343796] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.343936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.344011] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.344419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.344606] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.344691] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.344758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.344918] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.345010] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.345113] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.466245] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 1058.466634] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b deletion is rescheduled due to dependency. [ 1058.466634] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.466723] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.466957] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.467966] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.467966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.467966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.467966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.467966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.468288] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.848562] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.848780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.848877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.849172] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.849277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.849535] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.849652] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.849719] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.850238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.850238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.850238] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 is going to be updated. [ 1058.879087] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.879762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.879762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.879906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.880065] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.890777] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: IN_PROGRESS for 2s [ 1058.910206] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-275 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.910206] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-275" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.910206] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-275" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.910785] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-275" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.911257] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.911665] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.911972] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.912392] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.913346] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.914039] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1058.916073] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1058.916073] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1058.916073] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1058.916073] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1058.916073] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1058.916073] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1058.938629] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1058.938629] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1058.938629] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1058.938629] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-275" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.938629] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-327be5fc-cd60-430b-9e3c-b4ab5465492a taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.938629] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-327be5fc-cd60-430b-9e3c-b4ab5465492a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.938629] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-327be5fc-cd60-430b-9e3c-b4ab5465492a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.938629] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-327be5fc-cd60-430b-9e3c-b4ab5465492a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.938629] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('327be5fc-cd60-430b-9e3c-b4ab5465492a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.972124] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.441601] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.442536] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.442710] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.443051] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.443244] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.443423] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 327be5fc-cd60-430b-9e3c-b4ab5465492a not found, creating... [ 1059.447156] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.447156] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.447156] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.447156] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.447156] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.447156] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.447156] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.447156] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.447156] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.447156] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.448095] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 327be5fc-cd60-430b-9e3c-b4ab5465492a is going to be created. [ 1059.468905] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.469332] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.469332] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.469882] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.469882] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.470080] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-327be5fc-cd60-430b-9e3c-b4ab5465492a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.473812] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.979383] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.979383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.979383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.979383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.979383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.979383] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 1060.012203] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.012813] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.013020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.013349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.014153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.024072] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 1060.174677] env[69343]: INFO networking_nsxv3.common.synchronization [req-0d69a627-3d32-4bd4-b554-1f469517cf23 req-69ee89d7-ebb0-4e2d-8255-019b24c10988 service nova] Enqueued Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_rules [ 1060.174784] env[69343]: INFO networking_nsxv3.common.synchronization [req-0d69a627-3d32-4bd4-b554-1f469517cf23 req-69ee89d7-ebb0-4e2d-8255-019b24c10988 service nova] Enqueued Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1060.174937] env[69343]: INFO networking_nsxv3.common.synchronization [req-0d69a627-3d32-4bd4-b554-1f469517cf23 req-69ee89d7-ebb0-4e2d-8255-019b24c10988 service nova] Enqueued Resource ID: 327be5fc-cd60-430b-9e3c-b4ab5465492a with Priority: HIGHEST for action port [ 1060.175197] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_rules [ 1060.175325] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1060.175422] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327be5fc-cd60-430b-9e3c-b4ab5465492a with Priority: HIGHEST for action port [ 1060.176562] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.176740] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.176843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.177139] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.177608] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.178760] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.180508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.181103] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-327be5fc-cd60-430b-9e3c-b4ab5465492a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.181278] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-327be5fc-cd60-430b-9e3c-b4ab5465492a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.181762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-327be5fc-cd60-430b-9e3c-b4ab5465492a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.182963] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-327be5fc-cd60-430b-9e3c-b4ab5465492a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.183129] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('327be5fc-cd60-430b-9e3c-b4ab5465492a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.222839] env[69343]: INFO networking_nsxv3.common.synchronization [req-ff3590b0-4c27-4771-94a4-18a9181a014c req-4e54a9cc-6b3c-4686-af75-4c1216e76a9d tempest-AttachVolumeTestJSON-1370042024 tempest-AttachVolumeTestJSON-1370042024-project-member] Enqueued Resource ID: 69f44a11-7085-48b3-ad36-634a77d99f4a with Priority: HIGHEST for action security_group_members [ 1060.223330] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f44a11-7085-48b3-ad36-634a77d99f4a with Priority: HIGHEST for action security_group_members [ 1060.223636] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-69f44a11-7085-48b3-ad36-634a77d99f4a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.223767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.223841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.224102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.224270] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.224347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.224347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.224493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.224578] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.224933] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69f44a11-7085-48b3-ad36-634a77d99f4a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.687945] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.687945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.688362] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 327be5fc-cd60-430b-9e3c-b4ab5465492a with status ACTIVE [ 1060.688362] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.688444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.688444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.688771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.688771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.688889] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.688968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.689046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.689201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.689279] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.689547] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.689547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.689693] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.689730] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.689869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.689869] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 327be5fc-cd60-430b-9e3c-b4ab5465492a is going to be updated. [ 1060.714873] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.715118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.715176] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.715346] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.715487] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.715648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-327be5fc-cd60-430b-9e3c-b4ab5465492a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.726368] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.726535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.726631] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.726848] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.727294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.727294] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.727294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.727476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.727476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.727542] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.727640] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f44a11-7085-48b3-ad36-634a77d99f4a is going to be updated. [ 1060.756991] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.757622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.757622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.757622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.757622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.767187] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f44a11-7085-48b3-ad36-634a77d99f4a in Status: IN_PROGRESS for 2s [ 1060.901922] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: SUCCESS [ 1060.902251] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 deletion is rescheduled due to dependency. [ 1060.902360] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.902462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.902733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.902952] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.903128] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.903202] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.903333] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.904121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.904121] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.405871] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.908547] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.036559] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 1062.036791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.036959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.037502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.037502] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.037729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.037729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.037729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.037877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.037927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.038087] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.222341] env[69343]: INFO networking_nsxv3.common.synchronization [req-abb9f5cf-ee7b-438f-a2fb-e6247f12391e req-8408eba7-9555-4b0d-9056-7cf6689782c0 tempest-ServersTestJSON-245111932 tempest-ServersTestJSON-245111932-project-member] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1062.222918] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1062.223662] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.223803] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.223864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.224883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.227590] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.227590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.227590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.227590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.227590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.227590] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.412374] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.412638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.412638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.412931] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.413121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.413284] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 is going to be updated. [ 1062.446593] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.446804] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.446855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.447102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.447343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.458725] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: IN_PROGRESS for 2s [ 1062.540200] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.540361] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.540468] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.540653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.540819] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.540915] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.541028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.541116] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.541207] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.541294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.541440] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.541534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.541609] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.541754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.541898] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.541980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.542069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.542187] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.542263] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.542344] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.542433] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.729752] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.776546] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69f44a11-7085-48b3-ad36-634a77d99f4a in Status: SUCCESS [ 1062.776739] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69f44a11-7085-48b3-ad36-634a77d99f4a deletion is rescheduled due to dependency. [ 1062.777067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.045438] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3973f86f-0821-4b7d-9e21-ccfe561c705b: rpc.has_security_group_logging(os_id): False [ 1063.068808] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.069060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.069060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.069258] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.069350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.069542] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.069642] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.069707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.069853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.069951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.070515] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.070515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.070515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.070760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.070760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.070865] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.070927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.070967] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.071120] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.071222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.071275] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 1063.156936] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.156936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.156936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.156936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.156936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.170801] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 1063.231453] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.734400] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.734562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.734678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.734931] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.735058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.735167] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1063.772850] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.773099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.773215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.773506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.773714] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.786582] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1064.469055] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: SUCCESS [ 1064.469477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.469477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.469707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.470134] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.470259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.470343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.470535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.470589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.470678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.470766] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.973172] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.973437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.973503] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.973880] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.974123] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.974256] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.974362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.974583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.974752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.974896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.975112] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.975238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.975326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.975553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.975770] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.975932] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.976045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.976252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.976382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.976528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.976672] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.189809] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 1065.190266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.479430] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8: rpc.has_security_group_logging(os_id): False [ 1065.502864] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.502864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.502864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.502864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.502864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.503229] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.503229] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.503229] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.503229] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.503484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.503552] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.503599] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.503722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.503888] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.503982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.504499] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.504499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.504499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.504499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.504747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.504747] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 is going to be updated. [ 1065.573019] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.573019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.573019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.573302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.573342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.590226] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: IN_PROGRESS for 2s [ 1065.797064] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1065.797064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.224138] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1067.224138] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1067.605293] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: SUCCESS [ 1067.605514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.901054] env[69343]: INFO networking_nsxv3.common.synchronization [req-1acea84d-a7b5-430e-aae0-46fa5c512dda req-e79de5bc-2513-4fb1-9261-dfcef097667c tempest-ServerActionsTestOtherA-678333832 tempest-ServerActionsTestOtherA-678333832-project-member] Enqueued Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGHEST for action security_group_members [ 1068.901727] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGHEST for action security_group_members [ 1068.901962] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b63028d-55ab-4a15-b3eb-44ca69536be6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.902103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.902176] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.902373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.902527] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.902623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.902727] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.902864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.903058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.903253] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.405769] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.405933] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.406014] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.406244] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.406340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.406571] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.406725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.406800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.406950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.407042] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.407133] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 is going to be deleted. [ 1069.441519] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.441695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.441759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.441939] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.442048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.442153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.484711] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-184 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.484925] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.485084] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.485342] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.485650] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.486248] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.486438] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.486682] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.486841] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.487206] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.487485] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.487485] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.487617] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.487825] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.487999] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.488178] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.507610] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.507787] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1069.507931] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.508122] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.508479] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-4a9947c5-a5aa-4ef9-808c-2d38eb1258f0 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.508676] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-4a9947c5-a5aa-4ef9-808c-2d38eb1258f0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.508806] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-4a9947c5-a5aa-4ef9-808c-2d38eb1258f0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.509200] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-4a9947c5-a5aa-4ef9-808c-2d38eb1258f0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.509364] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a9947c5-a5aa-4ef9-808c-2d38eb1258f0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.011709] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.012035] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.012245] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.012382] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.012538] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.012712] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 4a9947c5-a5aa-4ef9-808c-2d38eb1258f0 not found, creating... [ 1070.012982] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.013164] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.013286] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.013516] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.013664] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.014000] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.014179] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.014304] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.014522] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.014665] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.014819] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 4a9947c5-a5aa-4ef9-808c-2d38eb1258f0 is going to be created. [ 1070.036512] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.036776] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.036986] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.037698] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.037698] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.037793] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-4a9947c5-a5aa-4ef9-808c-2d38eb1258f0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.862890] env[69343]: INFO networking_nsxv3.common.synchronization [None req-9f35a9bf-e3bb-45e3-a2b9-97defdca0c5a None None] Enqueued Resource ID: c0e842ff-0e32-416f-80cc-7eff5a4d2752 with Priority: HIGHEST for action port [ 1070.862890] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0e842ff-0e32-416f-80cc-7eff5a4d2752 with Priority: HIGHEST for action port [ 1070.863329] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0e842ff-0e32-416f-80cc-7eff5a4d2752 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.863637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0e842ff-0e32-416f-80cc-7eff5a4d2752" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.863637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0e842ff-0e32-416f-80cc-7eff5a4d2752" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.864552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0e842ff-0e32-416f-80cc-7eff5a4d2752" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.864703] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0e842ff-0e32-416f-80cc-7eff5a4d2752',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.050875] env[69343]: INFO networking_nsxv3.common.synchronization [req-1acea84d-a7b5-430e-aae0-46fa5c512dda req-d5bb605b-7398-424b-904f-bf4a938eac3a service nova] Enqueued Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGHEST for action security_group_rules [ 1071.051160] env[69343]: INFO networking_nsxv3.common.synchronization [req-1acea84d-a7b5-430e-aae0-46fa5c512dda req-d5bb605b-7398-424b-904f-bf4a938eac3a service nova] Enqueued Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGHEST for action security_group_members [ 1071.052576] env[69343]: INFO networking_nsxv3.common.synchronization [req-1acea84d-a7b5-430e-aae0-46fa5c512dda req-d5bb605b-7398-424b-904f-bf4a938eac3a service nova] Enqueued Resource ID: 4a9947c5-a5aa-4ef9-808c-2d38eb1258f0 with Priority: HIGHEST for action port [ 1071.052576] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGHEST for action security_group_rules [ 1071.052576] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGHEST for action security_group_members [ 1071.052576] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a9947c5-a5aa-4ef9-808c-2d38eb1258f0 with Priority: HIGHEST for action port [ 1071.053080] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b63028d-55ab-4a15-b3eb-44ca69536be6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.053158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.053305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.054186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.054305] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.057020] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b63028d-55ab-4a15-b3eb-44ca69536be6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.057020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.057020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.057020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.057020] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.057020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.057020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.057020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.057020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.057020] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.058655] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a9947c5-a5aa-4ef9-808c-2d38eb1258f0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.058796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a9947c5-a5aa-4ef9-808c-2d38eb1258f0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.058863] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a9947c5-a5aa-4ef9-808c-2d38eb1258f0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.059101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a9947c5-a5aa-4ef9-808c-2d38eb1258f0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.059187] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a9947c5-a5aa-4ef9-808c-2d38eb1258f0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.210759] env[69343]: INFO networking_nsxv3.common.synchronization [req-220ad755-6c5e-41b0-a691-0527ca4df3e0 req-26e0350c-7738-4068-b79c-0542c4543c02 tempest-ServerDiskConfigTestJSON-1018188129 tempest-ServerDiskConfigTestJSON-1018188129-project-member] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 1071.211997] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGHEST for action security_group_members [ 1071.213058] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.213476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.213476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.213627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.213841] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.214229] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.214514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.215196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.215196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.215196] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.368369] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0e842ff-0e32-416f-80cc-7eff5a4d2752 [ 1071.368555] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.368693] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.368748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.369067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.369173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.369273] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0e842ff-0e32-416f-80cc-7eff5a4d2752 already deleted. [ 1071.369356] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0e842ff-0e32-416f-80cc-7eff5a4d2752" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.463875] env[69343]: INFO networking_nsxv3.common.synchronization [None req-b93081c7-d800-420e-8789-c565aea87505 tempest-AttachVolumeShelveTestJSON-1111703815 tempest-AttachVolumeShelveTestJSON-1111703815-project-member] Enqueued Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGHEST for action security_group_rules [ 1071.464125] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGHEST for action security_group_rules [ 1071.464398] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bec412e-0e1e-4a5b-8816-552633942519 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.464505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.464543] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.464766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.464853] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.554974] env[69343]: INFO networking_nsxv3.common.synchronization [None req-f7254bad-0050-4b36-8298-46bc94d0877f tempest-AttachVolumeShelveTestJSON-1111703815 tempest-AttachVolumeShelveTestJSON-1111703815-project-member] Enqueued Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGHEST for action security_group_rules [ 1071.554974] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGHEST for action security_group_rules [ 1071.555158] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bec412e-0e1e-4a5b-8816-552633942519 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.555212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.560994] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b63028d-55ab-4a15-b3eb-44ca69536be6 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.561899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.561899] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.562890] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a9947c5-a5aa-4ef9-808c-2d38eb1258f0 with status ACTIVE [ 1071.564310] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.564411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.564411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.564674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.564715] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.564924] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.565047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.565113] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.565280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.565414] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.566573] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.566573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.566573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.566573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.566573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.566573] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a9947c5-a5aa-4ef9-808c-2d38eb1258f0 is going to be updated. [ 1071.589089] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.589235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.589305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.589517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.589655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.589811] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a9947c5-a5aa-4ef9-808c-2d38eb1258f0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.717295] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.717502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.717502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.717678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.717772] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.717984] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.718101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.718167] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.718328] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.718534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.718534] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be updated. [ 1071.734871] env[69343]: INFO networking_nsxv3.common.synchronization [req-dd2ae109-2fc5-4957-872e-95d32dc730cf req-371165a1-ceb2-4c99-860c-c5395469dfc6 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: d8742911-68ce-4e04-af8f-97f736173e2f with Priority: HIGHEST for action security_group_members [ 1071.735543] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8742911-68ce-4e04-af8f-97f736173e2f with Priority: HIGHEST for action security_group_members [ 1071.735812] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8742911-68ce-4e04-af8f-97f736173e2f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.735939] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.736013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.736417] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.736525] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.736587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.736632] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.736791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.737019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.737156] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8742911-68ce-4e04-af8f-97f736173e2f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.762583] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.762583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.762583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.762583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.762583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.774430] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: IN_PROGRESS for 2s [ 1071.988415] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.988415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.988415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.988415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.988415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.988415] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bec412e-0e1e-4a5b-8816-552633942519 already deleted. [ 1071.988415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.988806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.988806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.988806] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.073775] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.239635] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.239810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.239874] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.240113] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.240213] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.240429] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.240578] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.240643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.240847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.240847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.240942] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8742911-68ce-4e04-af8f-97f736173e2f already deleted. [ 1072.241046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.313018] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.313285] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.313496] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.313973] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.314819] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.314955] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.315090] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.315334] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.315484] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.315703] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1072.315836] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1072.315973] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1072.316110] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1072.319902] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1072.319902] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1072.319902] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1072.341379] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1072.341569] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1072.341758] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1072.342295] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.342741] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-b73e4420-b97a-40fe-958c-b4c467f30761 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.343011] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-b73e4420-b97a-40fe-958c-b4c467f30761" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.343222] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-b73e4420-b97a-40fe-958c-b4c467f30761" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.343727] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-b73e4420-b97a-40fe-958c-b4c467f30761" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.343905] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b73e4420-b97a-40fe-958c-b4c467f30761',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.511010] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.511193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.511268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.511480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.511613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.512484] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bec412e-0e1e-4a5b-8816-552633942519 already deleted. [ 1072.512484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.574577] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.574768] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.574843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.575090] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.575191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.575312] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 is going to be created. [ 1072.606991] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.607181] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.607226] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.607520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.607629] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.619145] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 in Status: UNINITIALIZED for 2s [ 1072.847980] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.848308] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.848486] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.848790] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.848959] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.849164] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port b73e4420-b97a-40fe-958c-b4c467f30761 not found, creating... [ 1072.849443] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.849613] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.849738] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.849977] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.850170] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.850592] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.850671] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.850756] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.850960] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.851199] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.851349] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: b73e4420-b97a-40fe-958c-b4c467f30761 is going to be created. [ 1072.874973] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.876027] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.876027] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.876027] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.876027] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.876261] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-b73e4420-b97a-40fe-958c-b4c467f30761" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.671913] env[69343]: INFO networking_nsxv3.common.synchronization [None req-0905914f-cdc6-4014-88b3-33f8e7a429d0 None None] Enqueued Resource ID: 9ed5b17c-baf8-472a-8dbc-b0e6469a2d80 with Priority: HIGHEST for action port [ 1073.673060] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed5b17c-baf8-472a-8dbc-b0e6469a2d80 with Priority: HIGHEST for action port [ 1073.673060] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ed5b17c-baf8-472a-8dbc-b0e6469a2d80 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.673247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ed5b17c-baf8-472a-8dbc-b0e6469a2d80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.673247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ed5b17c-baf8-472a-8dbc-b0e6469a2d80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.673493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ed5b17c-baf8-472a-8dbc-b0e6469a2d80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.673558] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ed5b17c-baf8-472a-8dbc-b0e6469a2d80',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.795696] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b in Status: SUCCESS [ 1073.795932] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b deletion is rescheduled due to dependency. [ 1073.796027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.913811] env[69343]: INFO networking_nsxv3.common.synchronization [req-dd2ae109-2fc5-4957-872e-95d32dc730cf req-f200c756-476d-42c9-9f80-6b4519f3aef8 service nova] Enqueued Resource ID: d8742911-68ce-4e04-af8f-97f736173e2f with Priority: HIGHEST for action security_group_rules [ 1073.913811] env[69343]: INFO networking_nsxv3.common.synchronization [req-dd2ae109-2fc5-4957-872e-95d32dc730cf req-f200c756-476d-42c9-9f80-6b4519f3aef8 service nova] Enqueued Resource ID: d8742911-68ce-4e04-af8f-97f736173e2f with Priority: HIGHEST for action security_group_members [ 1073.913929] env[69343]: INFO networking_nsxv3.common.synchronization [req-dd2ae109-2fc5-4957-872e-95d32dc730cf req-f200c756-476d-42c9-9f80-6b4519f3aef8 service nova] Enqueued Resource ID: b73e4420-b97a-40fe-958c-b4c467f30761 with Priority: HIGHEST for action port [ 1073.914863] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8742911-68ce-4e04-af8f-97f736173e2f with Priority: HIGHEST for action security_group_rules [ 1073.914863] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8742911-68ce-4e04-af8f-97f736173e2f with Priority: HIGHEST for action security_group_members [ 1073.914863] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b73e4420-b97a-40fe-958c-b4c467f30761 with Priority: HIGHEST for action port [ 1073.915167] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8742911-68ce-4e04-af8f-97f736173e2f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.916625] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.916731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.917287] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.917287] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8742911-68ce-4e04-af8f-97f736173e2f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.918021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8742911-68ce-4e04-af8f-97f736173e2f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.918143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.918214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.918398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.918601] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.918699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.918761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.918976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.919047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.919090] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8742911-68ce-4e04-af8f-97f736173e2f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.920779] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-b73e4420-b97a-40fe-958c-b4c467f30761 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.920886] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b73e4420-b97a-40fe-958c-b4c467f30761" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.920954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b73e4420-b97a-40fe-958c-b4c467f30761" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.921189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b73e4420-b97a-40fe-958c-b4c467f30761" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.921231] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b73e4420-b97a-40fe-958c-b4c467f30761',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.177315] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ed5b17c-baf8-472a-8dbc-b0e6469a2d80 [ 1074.177671] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.177868] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.177983] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.178285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.178422] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.178567] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ed5b17c-baf8-472a-8dbc-b0e6469a2d80 already deleted. [ 1074.178700] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ed5b17c-baf8-472a-8dbc-b0e6469a2d80" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.423560] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8742911-68ce-4e04-af8f-97f736173e2f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.424637] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8742911-68ce-4e04-af8f-97f736173e2f taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.427832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.427832] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b73e4420-b97a-40fe-958c-b4c467f30761 with status ACTIVE [ 1074.427832] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.427832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.427832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.427832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.427832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.427832] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.427832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.427832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.429152] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.429278] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.429464] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.429566] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.429621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.429796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.429877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.429962] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b73e4420-b97a-40fe-958c-b4c467f30761 is going to be updated. [ 1074.458457] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.458630] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.458698] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.458860] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.458987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.459164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b73e4420-b97a-40fe-958c-b4c467f30761" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.632029] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 in Status: SUCCESS [ 1074.632029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.632029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.632029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.632029] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.632029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.632809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.633338] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.635283] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.635283] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.635283] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.926085] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8742911-68ce-4e04-af8f-97f736173e2f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.139414] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b63028d-55ab-4a15-b3eb-44ca69536be6 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.139654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.139753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.139931] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.140098] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.140382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.140382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.140496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.140558] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.140805] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.140865] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b63028d-55ab-4a15-b3eb-44ca69536be6 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.141059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.141136] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.141263] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.141459] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.141758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.141844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.142098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.142251] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.142385] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.142534] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.430653] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.430849] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.430981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.431166] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.431325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.431379] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8742911-68ce-4e04-af8f-97f736173e2f is going to be created. [ 1075.456717] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.456870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.456959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.457498] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.457498] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.466675] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8742911-68ce-4e04-af8f-97f736173e2f in Status: UNINITIALIZED for 2s [ 1075.647382] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b63028d-55ab-4a15-b3eb-44ca69536be6: rpc.has_security_group_logging(os_id): False [ 1075.668260] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.668487] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.668487] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.668776] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.668901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.669142] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.669243] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.669318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.669569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.669645] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.670464] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.670464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.670464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.670464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.670464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.670785] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.670785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.670785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.670987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.671080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.671171] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 is going to be created. [ 1075.754285] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.754456] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.754530] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.754699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.754883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.766428] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 in Status: IN_PROGRESS for 2s [ 1077.477168] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8742911-68ce-4e04-af8f-97f736173e2f in Status: SUCCESS [ 1077.477679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.477679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.477917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.478144] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.478259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.478316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.478487] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.478556] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.478643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.478730] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8742911-68ce-4e04-af8f-97f736173e2f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.781761] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 in Status: SUCCESS [ 1077.781761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.980775] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8742911-68ce-4e04-af8f-97f736173e2f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.121123] env[69343]: INFO networking_nsxv3.common.synchronization [None req-a9431707-5cb4-4e5f-a5f5-750122190b75 None None] Enqueued Resource ID: 64074c37-b2c5-4d2d-bee9-0f3679d5d843 with Priority: HIGHEST for action port [ 1078.121123] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64074c37-b2c5-4d2d-bee9-0f3679d5d843 with Priority: HIGHEST for action port [ 1078.121673] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-64074c37-b2c5-4d2d-bee9-0f3679d5d843 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.121856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64074c37-b2c5-4d2d-bee9-0f3679d5d843" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.121948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64074c37-b2c5-4d2d-bee9-0f3679d5d843" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.122220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64074c37-b2c5-4d2d-bee9-0f3679d5d843" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.122308] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64074c37-b2c5-4d2d-bee9-0f3679d5d843',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.484867] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8742911-68ce-4e04-af8f-97f736173e2f: rpc.has_security_group_logging(os_id): False [ 1078.503214] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.503357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.503427] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.503649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.503742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.504014] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.504183] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.504246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.504408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.504488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.504645] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8742911-68ce-4e04-af8f-97f736173e2f is going to be created. [ 1078.603026] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.603026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.603026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.603026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.603026] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.625380] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64074c37-b2c5-4d2d-bee9-0f3679d5d843 [ 1078.625906] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.626053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.626053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.626425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.626425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.626425] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64074c37-b2c5-4d2d-bee9-0f3679d5d843 already deleted. [ 1078.626587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64074c37-b2c5-4d2d-bee9-0f3679d5d843" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.629035] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8742911-68ce-4e04-af8f-97f736173e2f in Status: IN_PROGRESS for 2s [ 1079.831723] env[69343]: INFO networking_nsxv3.common.synchronization [req-633f6501-64db-49b3-9dc4-2d1a63169437 req-74044ac3-f13b-4c12-8482-15845a669f46 tempest-ServerActionsTestOtherA-678333832 tempest-ServerActionsTestOtherA-678333832-project-member] Enqueued Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGHEST for action security_group_members [ 1079.832360] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGHEST for action security_group_members [ 1079.832675] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b63028d-55ab-4a15-b3eb-44ca69536be6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.832830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.832954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.835272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.838606] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.838769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.838837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.839010] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.839110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.839241] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.155416] env[69343]: INFO networking_nsxv3.common.synchronization [req-633f6501-64db-49b3-9dc4-2d1a63169437 req-74044ac3-f13b-4c12-8482-15845a669f46 tempest-ServerActionsTestOtherA-678333832 tempest-ServerActionsTestOtherA-678333832-project-member] Enqueued Resource ID: 4a9947c5-a5aa-4ef9-808c-2d38eb1258f0 with Priority: HIGHEST for action port [ 1080.155416] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a9947c5-a5aa-4ef9-808c-2d38eb1258f0 with Priority: HIGHEST for action port [ 1080.155583] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a9947c5-a5aa-4ef9-808c-2d38eb1258f0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.155709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a9947c5-a5aa-4ef9-808c-2d38eb1258f0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.155777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a9947c5-a5aa-4ef9-808c-2d38eb1258f0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.155980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a9947c5-a5aa-4ef9-808c-2d38eb1258f0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.156077] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a9947c5-a5aa-4ef9-808c-2d38eb1258f0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.343347] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.343545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.343643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.344014] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.344708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.347036] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.347036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.347036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.347036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.347036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.347036] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 is going to be updated. [ 1080.381784] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.381784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.381784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.381784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.381784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.394596] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 in Status: IN_PROGRESS for 2s [ 1080.582492] env[69343]: INFO networking_nsxv3.common.synchronization [None req-2c7f97c2-9a39-468f-a8fb-47351aac5a52 None None] Enqueued Resource ID: eb884906-0072-4218-b9a7-745c4dc72b2e with Priority: HIGHEST for action port [ 1080.582913] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb884906-0072-4218-b9a7-745c4dc72b2e with Priority: HIGHEST for action port [ 1080.583590] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb884906-0072-4218-b9a7-745c4dc72b2e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.583590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb884906-0072-4218-b9a7-745c4dc72b2e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.584839] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb884906-0072-4218-b9a7-745c4dc72b2e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.585032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb884906-0072-4218-b9a7-745c4dc72b2e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.585149] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb884906-0072-4218-b9a7-745c4dc72b2e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.652385] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8742911-68ce-4e04-af8f-97f736173e2f in Status: SUCCESS [ 1080.652619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.659189] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a9947c5-a5aa-4ef9-808c-2d38eb1258f0 with status ACTIVE [ 1080.659541] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.659737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.659869] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.660128] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.660252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.660499] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.660644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.660791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.660987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.661086] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.661279] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.661381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.661435] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.661585] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.661659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.661743] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a9947c5-a5aa-4ef9-808c-2d38eb1258f0 is going to be updated. [ 1080.690086] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.690228] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.690290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.690535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.690689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.690867] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a9947c5-a5aa-4ef9-808c-2d38eb1258f0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.093147] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb884906-0072-4218-b9a7-745c4dc72b2e [ 1081.093147] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.093147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.093147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.093147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.093147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.093147] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb884906-0072-4218-b9a7-745c4dc72b2e already deleted. [ 1081.093147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb884906-0072-4218-b9a7-745c4dc72b2e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.183624] env[69343]: INFO networking_nsxv3.common.synchronization [req-d0190a2c-ef44-48e0-8023-41e352a690ed req-f583abaf-b497-4d51-91b6-8ebfac4a93f1 tempest-ImagesOneServerNegativeTestJSON-7986261 tempest-ImagesOneServerNegativeTestJSON-7986261-project-member] Enqueued Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1081.183624] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1081.183624] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.184048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.184291] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.186648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.186648] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.186648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.186648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.186648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.186648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.186648] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.689078] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.689078] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.689078] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.689078] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.689078] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.689078] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.689078] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.689505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.689505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.689505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.689505] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 is going to be updated. [ 1081.717201] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.717425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.717467] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.717684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.717836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.726846] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: IN_PROGRESS for 2s [ 1082.404735] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 in Status: SUCCESS [ 1082.405482] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 deletion is rescheduled due to dependency. [ 1082.405741] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.738033] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: SUCCESS [ 1083.738033] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 deletion is rescheduled due to dependency. [ 1083.738033] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.138022] env[69343]: INFO networking_nsxv3.common.synchronization [None req-2f97d876-2aba-4a59-a759-36229d5aa36b None None] Enqueued Resource ID: adb825a2-98fe-4c0c-9b27-dd3c43348e2f with Priority: HIGHEST for action port [ 1085.138022] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb825a2-98fe-4c0c-9b27-dd3c43348e2f with Priority: HIGHEST for action port [ 1085.138022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-adb825a2-98fe-4c0c-9b27-dd3c43348e2f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.138022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adb825a2-98fe-4c0c-9b27-dd3c43348e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.138022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adb825a2-98fe-4c0c-9b27-dd3c43348e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.138022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adb825a2-98fe-4c0c-9b27-dd3c43348e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.138022] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adb825a2-98fe-4c0c-9b27-dd3c43348e2f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.640067] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port adb825a2-98fe-4c0c-9b27-dd3c43348e2f [ 1085.640327] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.640463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.640530] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.640826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.640965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.641229] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:adb825a2-98fe-4c0c-9b27-dd3c43348e2f already deleted. [ 1085.641229] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adb825a2-98fe-4c0c-9b27-dd3c43348e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.162804] env[69343]: INFO networking_nsxv3.common.synchronization [None req-7d4ed67e-ced5-4368-b830-dce9daaef31a None None] Enqueued Resource ID: db71b81b-aaf5-40e4-a442-4dfc158852ea with Priority: HIGHEST for action port [ 1087.162804] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db71b81b-aaf5-40e4-a442-4dfc158852ea with Priority: HIGHEST for action port [ 1087.163434] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-db71b81b-aaf5-40e4-a442-4dfc158852ea taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.163516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db71b81b-aaf5-40e4-a442-4dfc158852ea" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.163623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db71b81b-aaf5-40e4-a442-4dfc158852ea" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.163998] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db71b81b-aaf5-40e4-a442-4dfc158852ea" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.164151] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db71b81b-aaf5-40e4-a442-4dfc158852ea',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.667535] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db71b81b-aaf5-40e4-a442-4dfc158852ea [ 1087.667781] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.667923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.667992] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.668248] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.668442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.668442] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db71b81b-aaf5-40e4-a442-4dfc158852ea already deleted. [ 1087.668966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db71b81b-aaf5-40e4-a442-4dfc158852ea" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.433017] env[69343]: INFO networking_nsxv3.common.synchronization [req-0f096f55-cdf0-4d4f-9df7-12bb6f7a7c42 req-e586503c-7d1b-4c7b-b1d1-06474e9742f7 tempest-AttachVolumeShelveTestJSON-1111703815 tempest-AttachVolumeShelveTestJSON-1111703815-project-member] Enqueued Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGHEST for action security_group_members [ 1089.433017] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGHEST for action security_group_members [ 1089.433017] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bec412e-0e1e-4a5b-8816-552633942519 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.433017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.433017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.433017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.433017] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.433017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.433017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.433017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.433017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.433017] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.937947] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.938157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.938289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.938570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.938682] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.938918] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.939060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.939131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.939318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.939400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.939514] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bec412e-0e1e-4a5b-8816-552633942519 already deleted. [ 1089.939603] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.325038] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.325038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-656" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.325038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-656" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.325038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-656" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.325038] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.325038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.325038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.325545] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.325883] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.326290] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.326499] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1090.326739] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1090.327076] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1090.327318] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.327525] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1090.327748] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1090.353050] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1090.353050] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1090.353050] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1090.353050] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-656" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.353050] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.353050] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.353050] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.353050] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.353776] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cb84584-8dfb-4d6a-b489-e34fb17fdff9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.856619] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.857237] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.857237] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.857478] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.857478] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.857605] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 0cb84584-8dfb-4d6a-b489-e34fb17fdff9 not found, creating... [ 1090.857875] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.858055] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.858182] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.858576] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.858576] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.858850] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.859055] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.859214] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.859436] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.859579] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.859721] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 0cb84584-8dfb-4d6a-b489-e34fb17fdff9 is going to be created. [ 1090.891209] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.891520] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.891648] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.891938] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.892262] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.892571] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.494863] env[69343]: INFO networking_nsxv3.common.synchronization [req-cf976ff7-16a7-430e-8304-7ad60e25ffed req-2d762b34-9c88-4229-9aa1-d13bab3a9490 tempest-ServerActionsTestOtherB-1339566970 tempest-ServerActionsTestOtherB-1339566970-project-member] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 1091.495596] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 1091.497555] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.497555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.497555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.497555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.497555] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.497555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.497555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.497555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.497555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.497555] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.869928] env[69343]: INFO networking_nsxv3.common.synchronization [req-0f096f55-cdf0-4d4f-9df7-12bb6f7a7c42 req-2259550a-cb96-4fe8-9690-1d2042f23c32 service nova] Enqueued Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGHEST for action security_group_rules [ 1091.869928] env[69343]: INFO networking_nsxv3.common.synchronization [req-0f096f55-cdf0-4d4f-9df7-12bb6f7a7c42 req-2259550a-cb96-4fe8-9690-1d2042f23c32 service nova] Enqueued Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGHEST for action security_group_members [ 1091.869928] env[69343]: INFO networking_nsxv3.common.synchronization [req-0f096f55-cdf0-4d4f-9df7-12bb6f7a7c42 req-2259550a-cb96-4fe8-9690-1d2042f23c32 service nova] Enqueued Resource ID: 0cb84584-8dfb-4d6a-b489-e34fb17fdff9 with Priority: HIGHEST for action port [ 1091.869928] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGHEST for action security_group_rules [ 1091.869928] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGHEST for action security_group_members [ 1091.869928] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb84584-8dfb-4d6a-b489-e34fb17fdff9 with Priority: HIGHEST for action port [ 1091.869928] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bec412e-0e1e-4a5b-8816-552633942519 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.870737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.872862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.873140] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.873905] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.876611] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bec412e-0e1e-4a5b-8816-552633942519 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.876611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.876611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.876611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.876611] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.876611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.876611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.876611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.876611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.876611] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.877228] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.877343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.877472] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.877572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.877661] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cb84584-8dfb-4d6a-b489-e34fb17fdff9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.999687] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.999984] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.000615] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.001316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.001554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.001853] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.002032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.002152] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.003179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.003562] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.003633] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 is going to be updated. [ 1092.035023] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.035023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.035023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.035023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.035023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.045700] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: IN_PROGRESS for 2s [ 1092.379630] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.380882] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bec412e-0e1e-4a5b-8816-552633942519 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.380882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.381076] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0cb84584-8dfb-4d6a-b489-e34fb17fdff9 with status ACTIVE [ 1092.381217] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.381328] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.381394] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.381592] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.384552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.384552] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.384552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.384552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.384552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.384552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.384552] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.384552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.384552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.384552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.384552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.384552] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0cb84584-8dfb-4d6a-b489-e34fb17fdff9 is going to be updated. [ 1092.409349] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.410404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.410404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.410404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.410404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.410404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.885807] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.945698] env[69343]: INFO networking_nsxv3.common.synchronization [None req-22163c0b-770f-45e5-849f-323f5969687d None None] Enqueued Resource ID: 063cb794-c9d7-4366-9408-768932ce922a with Priority: HIGHEST for action port [ 1092.945965] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 063cb794-c9d7-4366-9408-768932ce922a with Priority: HIGHEST for action port [ 1092.946680] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-063cb794-c9d7-4366-9408-768932ce922a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.946759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-063cb794-c9d7-4366-9408-768932ce922a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.946868] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-063cb794-c9d7-4366-9408-768932ce922a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.951158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-063cb794-c9d7-4366-9408-768932ce922a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.951270] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('063cb794-c9d7-4366-9408-768932ce922a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.390572] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.390572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.390572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.390572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.390572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.390572] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bec412e-0e1e-4a5b-8816-552633942519 is going to be created. [ 1093.417262] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.417262] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.417262] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.417262] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.417569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.427625] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bec412e-0e1e-4a5b-8816-552633942519 in Status: UNINITIALIZED for 2s [ 1093.455429] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 063cb794-c9d7-4366-9408-768932ce922a [ 1093.455429] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.455604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.455604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.455875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.455875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.455977] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:063cb794-c9d7-4366-9408-768932ce922a already deleted. [ 1093.456074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-063cb794-c9d7-4366-9408-768932ce922a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.055409] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: SUCCESS [ 1094.055728] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 deletion is rescheduled due to dependency. [ 1094.055758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.172042] env[69343]: INFO networking_nsxv3.common.synchronization [req-fbb3eea2-836a-4030-99e0-d25a6a964e14 req-e7a44fc7-1707-42c1-ae0a-d8338f4c30db tempest-DeleteServersTestJSON-1417757124 tempest-DeleteServersTestJSON-1417757124-project-member] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1094.175634] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1094.176132] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.176306] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.176400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.176704] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.176900] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.177524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.177624] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.177830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.177930] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.178067] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.560784] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-284 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.561096] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.561282] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.561640] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.561957] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.562227] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.562414] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.562787] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.563012] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.563312] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1094.563488] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1094.563650] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1094.563809] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1094.563972] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1094.564188] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1094.564407] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1094.586039] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1094.586039] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1094.586039] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1094.586039] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.586039] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-dedf4136-14e4-42ac-afcf-2c68db865b4d taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.587140] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-dedf4136-14e4-42ac-afcf-2c68db865b4d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.587140] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-dedf4136-14e4-42ac-afcf-2c68db865b4d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.587140] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-dedf4136-14e4-42ac-afcf-2c68db865b4d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.587140] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dedf4136-14e4-42ac-afcf-2c68db865b4d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.688372] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.688538] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.688620] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.688851] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.688944] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.689153] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.689253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.689314] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.689455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.689533] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.689619] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e already deleted. [ 1094.689698] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.053857] env[69343]: INFO networking_nsxv3.common.synchronization [None req-36203452-f713-46aa-a83a-6bfd89d122e7 None None] Enqueued Resource ID: 35da45bd-99f8-4ca3-a2e2-67d43e61025e with Priority: HIGHEST for action port [ 1095.054153] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35da45bd-99f8-4ca3-a2e2-67d43e61025e with Priority: HIGHEST for action port [ 1095.054746] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-35da45bd-99f8-4ca3-a2e2-67d43e61025e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.054861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35da45bd-99f8-4ca3-a2e2-67d43e61025e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.054928] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35da45bd-99f8-4ca3-a2e2-67d43e61025e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.055232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35da45bd-99f8-4ca3-a2e2-67d43e61025e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.055294] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35da45bd-99f8-4ca3-a2e2-67d43e61025e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.092627] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.092944] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.093052] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.096019] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.096019] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.096019] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port dedf4136-14e4-42ac-afcf-2c68db865b4d not found, creating... [ 1095.096019] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.096019] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.096019] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.096019] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.096019] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.096656] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.096845] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.096975] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.097217] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.097360] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.097502] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: dedf4136-14e4-42ac-afcf-2c68db865b4d is going to be created. [ 1095.120960] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.121222] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.121350] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.125029] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.125029] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.125029] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-dedf4136-14e4-42ac-afcf-2c68db865b4d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.438726] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bec412e-0e1e-4a5b-8816-552633942519 in Status: SUCCESS [ 1095.438953] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.439132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.439341] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.439627] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.439695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.439695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.439843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.439924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.440024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.440119] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.558108] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35da45bd-99f8-4ca3-a2e2-67d43e61025e [ 1095.558305] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.558443] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.558512] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.558737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.558837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.558941] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35da45bd-99f8-4ca3-a2e2-67d43e61025e already deleted. [ 1095.559042] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35da45bd-99f8-4ca3-a2e2-67d43e61025e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.840909] env[69343]: INFO networking_nsxv3.common.synchronization [req-fbb3eea2-836a-4030-99e0-d25a6a964e14 req-ef59ecab-afb1-46ca-9017-9be2e995d765 service nova] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_rules [ 1095.841198] env[69343]: INFO networking_nsxv3.common.synchronization [req-fbb3eea2-836a-4030-99e0-d25a6a964e14 req-ef59ecab-afb1-46ca-9017-9be2e995d765 service nova] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1095.841380] env[69343]: INFO networking_nsxv3.common.synchronization [req-fbb3eea2-836a-4030-99e0-d25a6a964e14 req-ef59ecab-afb1-46ca-9017-9be2e995d765 service nova] Enqueued Resource ID: dedf4136-14e4-42ac-afcf-2c68db865b4d with Priority: HIGHEST for action port [ 1095.841619] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_rules [ 1095.841750] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1095.841848] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dedf4136-14e4-42ac-afcf-2c68db865b4d with Priority: HIGHEST for action port [ 1095.842556] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.842624] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.842716] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.842943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.843041] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.843887] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.844050] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.844130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.844316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.844475] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.844563] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.844622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.844760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.844847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.844928] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.845945] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-dedf4136-14e4-42ac-afcf-2c68db865b4d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.846067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dedf4136-14e4-42ac-afcf-2c68db865b4d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.846130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dedf4136-14e4-42ac-afcf-2c68db865b4d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.846285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dedf4136-14e4-42ac-afcf-2c68db865b4d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.846361] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dedf4136-14e4-42ac-afcf-2c68db865b4d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.942673] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.353021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.353021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.353021] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.353021] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dedf4136-14e4-42ac-afcf-2c68db865b4d with status ACTIVE [ 1096.353021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.353021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.353021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.353021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.353021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.353021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.353021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.353021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.353021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.353021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.353970] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.353970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.353970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.353970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.353970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.353970] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dedf4136-14e4-42ac-afcf-2c68db865b4d is going to be updated. [ 1096.384259] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.384458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.384557] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.384805] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.384982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.385198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dedf4136-14e4-42ac-afcf-2c68db865b4d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.445259] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bec412e-0e1e-4a5b-8816-552633942519: rpc.has_security_group_logging(os_id): False [ 1096.463122] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.463390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.463390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.463580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.463672] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.463930] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.464089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.464195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.464274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.464352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.464438] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bec412e-0e1e-4a5b-8816-552633942519 is going to be created. [ 1096.528865] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.529088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.529088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.529307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.529491] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.543893] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bec412e-0e1e-4a5b-8816-552633942519 in Status: IN_PROGRESS for 2s [ 1096.863512] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.365369] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.365779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.365779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.365856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.365889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.365985] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be created. [ 1097.393170] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.393393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.393517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.393786] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.394033] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.404648] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: UNINITIALIZED for 2s [ 1098.556352] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bec412e-0e1e-4a5b-8816-552633942519 in Status: SUCCESS [ 1098.556618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.222662] env[69343]: INFO networking_nsxv3.common.synchronization [req-7723ad39-e387-4154-af21-02b38b8ae57a req-afa64762-c32c-4630-b908-908601fee4cc tempest-AttachVolumeNegativeTest-1961671669 tempest-AttachVolumeNegativeTest-1961671669-project-member] Enqueued Resource ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f with Priority: HIGHEST for action security_group_members [ 1099.223270] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f with Priority: HIGHEST for action security_group_members [ 1099.223572] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.223694] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.223762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.223955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.225121] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.225238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.225304] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.225658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.225658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.225658] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.297133] env[69343]: INFO networking_nsxv3.common.synchronization [req-4a16927e-b6dd-4323-9353-2805fd9a0e8a req-ff8672de-50a0-4f03-a834-5b9e526de21e tempest-ServerActionsTestJSON-1397784852 tempest-ServerActionsTestJSON-1397784852-project-member] Enqueued Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 1099.301025] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 1099.301025] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.301025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.301025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.301025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.301025] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.301025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.301025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.301025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.301025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.301025] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.415369] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1099.415542] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.415797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.416145] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.416441] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.416678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.416826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.418017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.418017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.418017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.418017] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.730222] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.730222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.730222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.730222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.730222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.730222] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.730222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.730222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.730222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.730851] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.730851] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f is going to be updated. [ 1099.758896] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.759121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.759201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.759445] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.759600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.769156] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f in Status: IN_PROGRESS for 2s [ 1099.804071] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.804071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.804071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.804336] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.825174] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.825408] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.825552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.825624] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.825913] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.826068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.826196] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 is going to be updated. [ 1099.853611] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.853773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.853860] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.854137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.854353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.865031] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: IN_PROGRESS for 2s [ 1099.921769] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.921862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.921899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.922167] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.922418] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.922546] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.922613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.922780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.922866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.922955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.923195] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.923320] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.923374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.923498] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.923642] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.924391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.924391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.924391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.924391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.924391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.924391] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.426889] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c336180-c6d8-473b-8306-38646bd8e00e: rpc.has_security_group_logging(os_id): False [ 1100.446275] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.446416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.446502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.446725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.446818] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.446999] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.447120] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.447186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.447340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.447586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.447652] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.447698] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.447755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.447894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.447966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.449024] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.449024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.449024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.449192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.449192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.449245] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be created. [ 1100.505979] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.506148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.506188] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.506403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.506648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.516933] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1101.778998] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f in Status: SUCCESS [ 1101.778998] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f deletion is rescheduled due to dependency. [ 1101.779355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.874312] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: SUCCESS [ 1101.874497] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 deletion is rescheduled due to dependency. [ 1101.874615] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.900779] env[69343]: INFO networking_nsxv3.common.synchronization [req-07e32668-9ece-4a0d-8ce2-29d326f00dd6 req-6901ab16-dfe1-45b1-88c5-7e71cf531a98 tempest-ServersTestJSON-245111932 tempest-ServersTestJSON-245111932-project-member] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1101.901374] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1101.901697] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.901824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.901894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.902334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.902436] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.902567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.902652] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.902781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.902870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.902977] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.294147] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.294350] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.294482] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.294756] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.295031] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.295194] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.295315] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.295584] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.295694] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.295910] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1102.296034] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.296149] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.296260] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.296374] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1102.296482] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.296620] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1102.314408] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1102.314573] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1102.314923] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1102.315126] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.315445] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.315648] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.315777] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.316141] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.316289] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.408771] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.529300] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1102.529512] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.818719] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.819126] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.819126] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.819206] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.819364] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.819528] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd not found, creating... [ 1102.819791] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.819969] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.820108] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.820413] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.820554] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.820835] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.821010] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.821142] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.821355] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.821500] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.821651] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd is going to be created. [ 1102.850838] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.851083] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.851227] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.851524] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.851883] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.852160] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.910920] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.138926] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.139124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.139209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.139452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.139568] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.414314] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.414529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.414707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.414844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.414938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.415051] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1103.451621] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.451760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.451830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.452056] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.452618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.465022] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1103.575132] env[69343]: INFO networking_nsxv3.common.synchronization [req-07e32668-9ece-4a0d-8ce2-29d326f00dd6 req-0cb3b854-990b-4ef8-9d0a-255fee3c91e7 service nova] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_rules [ 1103.575309] env[69343]: INFO networking_nsxv3.common.synchronization [req-07e32668-9ece-4a0d-8ce2-29d326f00dd6 req-0cb3b854-990b-4ef8-9d0a-255fee3c91e7 service nova] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1103.575452] env[69343]: INFO networking_nsxv3.common.synchronization [req-07e32668-9ece-4a0d-8ce2-29d326f00dd6 req-0cb3b854-990b-4ef8-9d0a-255fee3c91e7 service nova] Enqueued Resource ID: aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd with Priority: HIGHEST for action port [ 1103.575686] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_rules [ 1103.575814] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1103.575913] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd with Priority: HIGHEST for action port [ 1103.576691] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.576754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.576830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.577039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.577125] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.577912] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.578014] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.578209] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.578313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.578384] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.578556] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.578621] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.642154] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.082694] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.082941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.082941] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd with status ACTIVE [ 1104.083086] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.083220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.083277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.083484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.083572] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.083738] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.083831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.083893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.084052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.084126] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.084321] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.084421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.084476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.084614] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.084686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.084768] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd is going to be updated. [ 1104.104998] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.105167] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.105210] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.105411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.105548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.105701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aebcb5b7-0a72-4fbb-b9b0-f02b359b3dfd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.144342] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.647941] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1104.647941] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1104.920992] env[69343]: INFO networking_nsxv3.common.synchronization [req-6c296003-4289-4873-9743-34cdd2638f93 req-8c2ce8d7-e477-4d50-be86-e545e1854fe2 tempest-ServersNegativeTestJSON-949345807 tempest-ServersNegativeTestJSON-949345807-project-member] Enqueued Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_members [ 1104.921534] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_members [ 1104.921838] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.921959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.923590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.923882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.924066] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.924179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.924260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.924428] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.924877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.924877] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.263673] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-109 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.263942] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-109" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.264084] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-109" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.264439] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-109" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.264703] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.264863] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.264985] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.265232] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.265384] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.265652] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.265780] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.265894] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.266013] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.266136] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.266244] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.266382] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1105.294019] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1105.294205] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1105.294341] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1105.294529] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-109" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.294840] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-fbb948d3-6d63-4b97-945d-768dfb6ff64b taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.295022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-fbb948d3-6d63-4b97-945d-768dfb6ff64b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.295151] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-fbb948d3-6d63-4b97-945d-768dfb6ff64b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.295484] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-fbb948d3-6d63-4b97-945d-768dfb6ff64b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.295629] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbb948d3-6d63-4b97-945d-768dfb6ff64b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.427930] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.428232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.428313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.428539] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.428655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.428896] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.429046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.429107] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.429381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.429381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.429518] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8943f91-6f84-437f-912a-5f193b3365a6 already deleted. [ 1105.429615] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.473791] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1105.474036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.474217] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.474478] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.474669] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.474785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.474849] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.475010] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.475103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.475201] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.490441] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.490441] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.490649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.490695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.502970] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1105.503929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.505012] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1105.581972] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.582197] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.582197] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.582277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.593832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.594768] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1105.594950] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1105.595136] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1105.655608] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.655814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.655940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.656188] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.658042] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.658042] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1105.738063] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.738241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.738375] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.738678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.739112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.739453] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1105.798522] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.798737] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.798853] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.799172] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.799327] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.799510] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port fbb948d3-6d63-4b97-945d-768dfb6ff64b not found, creating... [ 1105.799800] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.800150] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.800281] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.800508] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.800647] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.800939] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.801107] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.801226] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.801472] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.801626] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.801770] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: fbb948d3-6d63-4b97-945d-768dfb6ff64b is going to be created. [ 1105.812318] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.812537] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.812537] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.812775] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.813160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.813598] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1105.813721] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'47b39a17-6794-4f6b-b042-45a1e062090b', '39709bac-2d5f-45f1-8871-b8dc216058be', '7f3ee775-00c0-4c70-a79b-23338c04f67f', '799bea39-1ae9-4b19-a079-d999ce5c8ff0', 'cc3164ca-a0f8-4382-a1f9-ece149336a1a', '6aff3244-8376-4f32-8e71-5312a77febc9', '1ae935b4-2d91-4607-a4bb-d0ef7f831a7e', '05ba88a3-ba5e-41f6-a0be-392b43ae9fcc', 'a86385e4-9677-4817-aaf4-1d8d8e344e8d', '75c1cecf-8a26-40e7-a08b-f1a0818a4c6a', 'b70491af-3fc6-4261-a302-3d7d52606515', 'd6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f', '1ba723a9-f8bb-4746-b83f-2c283502bde3', '8bec412e-0e1e-4a5b-8816-552633942519', '5c336180-c6d8-473b-8306-38646bd8e00e', '6b63028d-55ab-4a15-b3eb-44ca69536be6', 'dec2bd26-cf02-479f-bf2c-2ca399054600', '7532335d-79e6-454d-9693-a5b2f8a9923a', '970edbb8-6a58-46c8-ad52-fe607c6c28e9', '4923a56f-6f82-4449-82ab-38fbf0c7542f', '2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b', '3973f86f-0821-4b7d-9e21-ccfe561c705b', 'b7614721-7a3e-40ba-83da-998503180bf3', 'f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9', '0c195ad8-d052-4923-b668-42944e44042c', '1d14af5b-7c75-428d-a5d6-e177dfd3d4e5', '5edd58c8-45a0-43c5-b788-4aa742334ad2', '7b7e2ff9-f297-4beb-8beb-6260aaac3c39', '69f44a11-7085-48b3-ad36-634a77d99f4a', '7ceec863-0a7a-401b-a8e8-048823180971', 'd8742911-68ce-4e04-af8f-97f736173e2f', '53614dab-3dfd-44ee-8ebe-f06847c53bb0', '4ff65ed7-3c36-4248-86bb-8bb20a53fde4', 'c88723a0-b73a-488b-a081-450e868cf48a', '6ce998c5-dc06-41cd-af9e-8a9554ca2092', '4f4a1283-038d-4b9a-8c1a-7e43a4c6645d', '67480949-2dd7-420c-b751-f7f48b752f53', 'a1f09c79-4735-45a5-8af5-ec47fcc9b65f', 'fdbb645d-14e7-4764-8083-5c521a4adb8c', '1db02b01-820f-4081-802a-12188735ffe1', 'c490ab0a-5a62-4845-ab43-b72f0c00e5c1', '3d094c60-3a3c-417f-8a4b-5bc3132f56a7', 'ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8', '06e6e2d6-f175-4be9-be9a-bdb1208e0e04', 'ac5de742-586a-4eea-8d29-9efb080dd556', 'f65fedc2-bd86-4b46-8ea8-95f7086801cf'} {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1105.813836] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1105.821449] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.821665] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.821811] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.822133] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.822387] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.822663] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-fbb948d3-6d63-4b97-945d-768dfb6ff64b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.839434] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.839434] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.839434] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.839701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.839701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.839701] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1105.839782] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1105.839811] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1105.921464] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.921667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.921667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.921863] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.922894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.923175] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1105.923299] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1105.923374] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1105.923440] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1105.923536] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1105.923590] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGH for action security_group_rules [ 1105.923661] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGH for action security_group_rules [ 1105.923725] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGH for action security_group_rules [ 1105.923786] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 with Priority: HIGH for action security_group_rules [ 1105.923846] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a with Priority: HIGH for action security_group_rules [ 1105.923905] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6aff3244-8376-4f32-8e71-5312a77febc9 with Priority: HIGH for action security_group_rules [ 1105.923960] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGH for action security_group_rules [ 1105.924170] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGH for action security_group_rules [ 1105.924170] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d with Priority: HIGH for action security_group_rules [ 1105.924170] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGH for action security_group_rules [ 1105.924327] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGH for action security_group_rules [ 1105.924327] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f with Priority: HIGH for action security_group_rules [ 1105.924467] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 with Priority: HIGH for action security_group_rules [ 1105.924467] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGH for action security_group_rules [ 1105.924467] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGH for action security_group_rules [ 1105.924591] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGH for action security_group_rules [ 1105.924591] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dec2bd26-cf02-479f-bf2c-2ca399054600 with Priority: HIGH for action security_group_rules [ 1105.924692] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7532335d-79e6-454d-9693-a5b2f8a9923a with Priority: HIGH for action security_group_rules [ 1105.924692] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGH for action security_group_rules [ 1105.924776] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f with Priority: HIGH for action security_group_rules [ 1105.924850] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.977177] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.479528] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.526909] env[69343]: INFO networking_nsxv3.common.synchronization [req-6c296003-4289-4873-9743-34cdd2638f93 req-700fc3ea-84b8-4856-9bf0-7b3d3815988a service nova] Enqueued Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_rules [ 1106.527112] env[69343]: INFO networking_nsxv3.common.synchronization [req-6c296003-4289-4873-9743-34cdd2638f93 req-700fc3ea-84b8-4856-9bf0-7b3d3815988a service nova] Enqueued Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_members [ 1106.527256] env[69343]: INFO networking_nsxv3.common.synchronization [req-6c296003-4289-4873-9743-34cdd2638f93 req-700fc3ea-84b8-4856-9bf0-7b3d3815988a service nova] Enqueued Resource ID: fbb948d3-6d63-4b97-945d-768dfb6ff64b with Priority: HIGHEST for action port [ 1106.527559] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_rules [ 1106.527695] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_members [ 1106.527791] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbb948d3-6d63-4b97-945d-768dfb6ff64b with Priority: HIGHEST for action port [ 1106.527890] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b39a17-6794-4f6b-b042-45a1e062090b with Priority: HIGH for action security_group_rules [ 1106.527987] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f with Priority: HIGH for action security_group_rules [ 1106.528093] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e with Priority: HIGH for action security_group_rules [ 1106.528183] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGH for action security_group_rules [ 1106.528273] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f with Priority: HIGH for action security_group_rules [ 1106.528364] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGH for action security_group_rules [ 1106.528474] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7532335d-79e6-454d-9693-a5b2f8a9923a with Priority: HIGH for action security_group_rules [ 1106.528576] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dec2bd26-cf02-479f-bf2c-2ca399054600 with Priority: HIGH for action security_group_rules [ 1106.528667] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGH for action security_group_rules [ 1106.528772] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 with Priority: HIGH for action security_group_rules [ 1106.528834] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 with Priority: HIGH for action security_group_rules [ 1106.528922] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f with Priority: HIGH for action security_group_rules [ 1106.529012] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70491af-3fc6-4261-a302-3d7d52606515 with Priority: HIGH for action security_group_rules [ 1106.529112] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a with Priority: HIGH for action security_group_rules [ 1106.529182] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d with Priority: HIGH for action security_group_rules [ 1106.529268] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aff3244-8376-4f32-8e71-5312a77febc9 with Priority: HIGH for action security_group_rules [ 1106.529353] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGH for action security_group_rules [ 1106.529711] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a with Priority: HIGH for action security_group_rules [ 1106.529809] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39709bac-2d5f-45f1-8871-b8dc216058be with Priority: HIGH for action security_group_rules [ 1106.529895] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 with Priority: HIGH for action security_group_rules [ 1106.530485] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.530610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.530678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.530934] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.531028] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.531830] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.535019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.535019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.535019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.535019] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.535019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.535019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.535019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.535019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.535019] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.535019] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbb948d3-6d63-4b97-945d-768dfb6ff64b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.535019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbb948d3-6d63-4b97-945d-768dfb6ff64b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.535019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbb948d3-6d63-4b97-945d-768dfb6ff64b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.535019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbb948d3-6d63-4b97-945d-768dfb6ff64b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.535019] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbb948d3-6d63-4b97-945d-768dfb6ff64b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.535673] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47b39a17-6794-4f6b-b042-45a1e062090b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.535673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.535673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.535673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.536021] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47b39a17-6794-4f6b-b042-45a1e062090b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.536508] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f3ee775-00c0-4c70-a79b-23338c04f67f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.536615] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.536653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.536798] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.536867] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f3ee775-00c0-4c70-a79b-23338c04f67f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.537751] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.537853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.537910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.538768] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.538849] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ae935b4-2d91-4607-a4bb-d0ef7f831a7e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.539565] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.539666] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.539729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.539872] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.539937] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.540618] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4923a56f-6f82-4449-82ab-38fbf0c7542f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.540712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.540771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.540911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.540977] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4923a56f-6f82-4449-82ab-38fbf0c7542f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.542356] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.542730] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.542730] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.542730] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.542841] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.543857] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7532335d-79e6-454d-9693-a5b2f8a9923a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.544095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.544174] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.544487] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.544572] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7532335d-79e6-454d-9693-a5b2f8a9923a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.546016] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dec2bd26-cf02-479f-bf2c-2ca399054600 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.546016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.546016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.546016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.546016] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dec2bd26-cf02-479f-bf2c-2ca399054600',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.546352] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bec412e-0e1e-4a5b-8816-552633942519 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.546464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.546526] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.546667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.546771] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.547624] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b63028d-55ab-4a15-b3eb-44ca69536be6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.547738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.547804] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.547948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.548022] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b63028d-55ab-4a15-b3eb-44ca69536be6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.549203] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ba723a9-f8bb-4746-b83f-2c283502bde3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.549203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.549203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.549203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.549203] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ba723a9-f8bb-4746-b83f-2c283502bde3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.549663] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.549792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.549821] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.549958] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.550363] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.551167] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b70491af-3fc6-4261-a302-3d7d52606515 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.551276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.551341] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.551489] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.551556] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b70491af-3fc6-4261-a302-3d7d52606515',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.552227] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.552319] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.552383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.552524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.552589] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75c1cecf-8a26-40e7-a08b-f1a0818a4c6a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.553272] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a86385e4-9677-4817-aaf4-1d8d8e344e8d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.553390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.553454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.553599] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.555020] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a86385e4-9677-4817-aaf4-1d8d8e344e8d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.555020] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6aff3244-8376-4f32-8e71-5312a77febc9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.555020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.555020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.555020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.555020] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6aff3244-8376-4f32-8e71-5312a77febc9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.555516] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.555611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.555679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.555821] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.555889] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.556814] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc3164ca-a0f8-4382-a1f9-ece149336a1a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.556814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.556814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.556940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.556940] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc3164ca-a0f8-4382-a1f9-ece149336a1a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.557552] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39709bac-2d5f-45f1-8871-b8dc216058be taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.557652] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.557705] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.557883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.557950] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39709bac-2d5f-45f1-8871-b8dc216058be',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.559077] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-799bea39-1ae9-4b19-a079-d999ce5c8ff0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.559179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.559275] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.559436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.559522] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('799bea39-1ae9-4b19-a079-d999ce5c8ff0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.975493] env[69343]: INFO networking_nsxv3.common.synchronization [req-435be3c4-ef2d-48b8-a8f1-7450a936247b req-b78fd23e-c2d0-4524-9e2a-10799c45aab0 tempest-DeleteServersTestJSON-1417757124 tempest-DeleteServersTestJSON-1417757124-project-member] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1106.976074] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1106.976384] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.976547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.976581] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.976761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.976910] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.977780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.977780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.977780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.977923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.977923] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.985023] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.987820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.987820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.987820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.987820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.987820] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1107.021209] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.021209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.021209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.021209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.021209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.029875] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1107.063124] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbb948d3-6d63-4b97-945d-768dfb6ff64b with status ACTIVE [ 1107.063124] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.063395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.063395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.063495] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.063579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.063752] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.063844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.063904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.064098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.064175] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.064350] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.067060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.067060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.067060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.067060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.067060] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbb948d3-6d63-4b97-945d-768dfb6ff64b is going to be updated. [ 1107.067250] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.067250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.075273] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.075400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.079673] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.079673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.079673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.079673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.079673] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.079673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.079673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.079673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.079673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.079673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.079673] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.080433] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.086406] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bec412e-0e1e-4a5b-8816-552633942519 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.086406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.086406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.086406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.086406] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.086406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.086406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.086406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.086406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.086406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.086406] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.145653] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.145838] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.145898] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.146122] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.155510] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.155769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.156831] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.156983] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.158331] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.158331] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.158980] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.159096] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.159778] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.159891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.160589] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.160725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.161558] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.161649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.162529] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.162640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.163457] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.163551] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.164760] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.164936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.165634] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1107.166060] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.166159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.170563] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1107.171335] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.171335] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.172292] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1107.172978] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.172978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.173698] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1107.174406] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.174406] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.174927] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1107.175427] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.175479] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.176018] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1107.176428] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.176579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.176677] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.176898] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.177048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.177204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbb948d3-6d63-4b97-945d-768dfb6ff64b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.177918] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1107.178214] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.178301] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.178949] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1107.179334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.179451] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6aff3244-8376-4f32-8e71-5312a77febc9 is going to be deleted. [ 1107.180420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.180613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.199134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.199324] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47b39a17-6794-4f6b-b042-45a1e062090b is going to be deleted. [ 1107.200203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.201035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.219774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.219925] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39709bac-2d5f-45f1-8871-b8dc216058be is going to be deleted. [ 1107.220842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.221067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.243803] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.243995] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ae935b4-2d91-4607-a4bb-d0ef7f831a7e is going to be deleted. [ 1107.244955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.245181] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.257012] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.257182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.263203] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.263412] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75c1cecf-8a26-40e7-a08b-f1a0818a4c6a is going to be deleted. [ 1107.264835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.265067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.280869] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.281031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.290816] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.291088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.299234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.299234] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b63028d-55ab-4a15-b3eb-44ca69536be6 is going to be deleted. [ 1107.300380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.300692] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.304272] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.304446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.366765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.367048] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a86385e4-9677-4817-aaf4-1d8d8e344e8d is going to be deleted. [ 1107.368035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.368296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.374880] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.375201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.411421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.411585] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f is going to be deleted. [ 1107.412654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.412947] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.451325] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.451537] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.480392] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.480392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.529141] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.529141] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.529674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.529763] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc3164ca-a0f8-4382-a1f9-ece149336a1a is going to be deleted. [ 1107.530667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.530910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.561988] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.562135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.583935] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.584206] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4923a56f-6f82-4449-82ab-38fbf0c7542f is going to be deleted. [ 1107.585900] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.586286] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.587857] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.595940] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.600762] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.650045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.650362] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dec2bd26-cf02-479f-bf2c-2ca399054600 is going to be deleted. [ 1107.651830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.652173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.690104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.690305] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b70491af-3fc6-4261-a302-3d7d52606515 is going to be deleted. [ 1107.691590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.691846] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.747996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.747996] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ba723a9-f8bb-4746-b83f-2c283502bde3 is going to be deleted. [ 1107.749471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.749877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.752465] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.752697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.796921] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.797129] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.813741] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.814022] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 799bea39-1ae9-4b19-a079-d999ce5c8ff0 is going to be deleted. [ 1107.815428] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.815793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.818582] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.818718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.819653] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.819816] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.884655] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.884832] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 is going to be deleted. [ 1107.885927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.886188] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.899114] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.899328] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.994898] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.995078] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7532335d-79e6-454d-9693-a5b2f8a9923a is going to be deleted. [ 1107.996165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.996393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.023357] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.024183] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.054401] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.054609] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.081966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.082155] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f3ee775-00c0-4c70-a79b-23338c04f67f is going to be deleted. [ 1108.083168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.083539] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.083643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.083776] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6aff3244-8376-4f32-8e71-5312a77febc9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.083938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.084131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.084230] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.084374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47b39a17-6794-4f6b-b042-45a1e062090b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.084926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.085130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.085214] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.085332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39709bac-2d5f-45f1-8871-b8dc216058be" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.085468] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.085686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.085766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.085883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ae935b4-2d91-4607-a4bb-d0ef7f831a7e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.086021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.087022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.087022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.087022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75c1cecf-8a26-40e7-a08b-f1a0818a4c6a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.087022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.087022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.087022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.087022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b63028d-55ab-4a15-b3eb-44ca69536be6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.087022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.087022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.090478] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc: rpc.has_security_group_logging(os_id): False [ 1108.098547] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.098547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.098547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.098723] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.098816] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.099015] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8943f91-6f84-437f-912a-5f193b3365a6 is going to be created. [ 1108.106963] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bec412e-0e1e-4a5b-8816-552633942519: rpc.has_security_group_logging(os_id): False [ 1108.125749] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.125893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.128732] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.128879] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.141095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.141455] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.141580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.141667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.142371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.142371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.142371] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1108.143205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.143462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.143552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.143674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a86385e4-9677-4817-aaf4-1d8d8e344e8d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.143836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.144742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.144742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.144742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6db9d93-bfb8-43cb-86e3-ce3bc2f6b16f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.144884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.144946] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.145041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.145194] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc3164ca-a0f8-4382-a1f9-ece149336a1a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.145292] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.145523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.145523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.145629] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4923a56f-6f82-4449-82ab-38fbf0c7542f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.145767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.145907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.145982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.146103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b70491af-3fc6-4261-a302-3d7d52606515" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.146226] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.146363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.146437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.146545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dec2bd26-cf02-479f-bf2c-2ca399054600" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.146662] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.146798] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.146871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.146976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ba723a9-f8bb-4746-b83f-2c283502bde3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.147120] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.147259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.147345] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.147478] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-799bea39-1ae9-4b19-a079-d999ce5c8ff0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.147608] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.147752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.147828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.148255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.148255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.148255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.155101] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.155217] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.178563] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.178949] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.178949] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.179133] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.179274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.201252] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: UNINITIALIZED for 2s [ 1108.214349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.214696] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.214696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.214696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.214883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.215945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.215945] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc is going to be updated. [ 1108.216178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.216409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.216557] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.216729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7532335d-79e6-454d-9693-a5b2f8a9923a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.216882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.217053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.239417] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.239417] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.239539] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.239714] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.239916] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.241530] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.241696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.253445] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.253776] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.253881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.253950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.254173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.254300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.254372] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bec412e-0e1e-4a5b-8816-552633942519 is going to be updated. [ 1108.255478] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.255646] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.255731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.255857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f3ee775-00c0-4c70-a79b-23338c04f67f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.256680] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1108.382119] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.382371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.382371] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.382683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.382782] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.398441] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: IN_PROGRESS for 2s [ 1108.407569] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.407752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.407790] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.407999] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.408175] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.421985] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bec412e-0e1e-4a5b-8816-552633942519 in Status: IN_PROGRESS for 2s [ 1109.040403] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1109.040787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.040927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.041544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.041544] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.041544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.041904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.041904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.041904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.042051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.042141] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.544588] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.544783] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.544837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.545158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.545376] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.545513] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.545613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.545799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.545914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.546043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.546225] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.546379] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.546482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.546673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.546830] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.546951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.547032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.547182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.547311] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.547350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.547441] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.990713] env[69343]: INFO networking_nsxv3.common.synchronization [req-55a062f7-13f3-4fbd-97e9-b247be919124 req-222b48f7-6fc1-46ae-9d59-b37e6df9cd02 tempest-ServerGroupTestJSON-1243996989 tempest-ServerGroupTestJSON-1243996989-project-member] Enqueued Resource ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd with Priority: HIGHEST for action security_group_members [ 1109.991543] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd with Priority: HIGHEST for action security_group_members [ 1109.991889] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-118b632b-56d4-49fc-a94f-fd72aafb1afd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.992021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.992079] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.992361] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.992529] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.992637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.992700] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.992865] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.993012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.993111] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('118b632b-56d4-49fc-a94f-fd72aafb1afd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.051031] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ff65ed7-3c36-4248-86bb-8bb20a53fde4: rpc.has_security_group_logging(os_id): False [ 1110.070149] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.070348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.070388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.071266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.093503] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.093629] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.093713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.093781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.093993] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.094079] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.094268] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.094390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.094437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.094602] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.094645] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.094821] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.094919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.095019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.095179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.095259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.095347] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1110.161791] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.161916] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.161916] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.162259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.162335] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.181699] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1110.221231] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: SUCCESS [ 1110.221231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.221231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.221231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.221231] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.221231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.221231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.221231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.221231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.221231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.221231] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.273235] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1110.273235] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e deletion is rescheduled due to dependency. [ 1110.273235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.273235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.273235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.273235] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.273235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.273235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.273235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.273235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.273235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.273235] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.346058] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-52 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.346267] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-52" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.346398] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-52" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.346747] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-52" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.347436] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.347614] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.347741] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.347969] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.348135] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.348349] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1110.348470] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.348584] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.348697] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.348809] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1110.348919] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.349071] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.385410] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.385410] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1110.385410] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.385410] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-52" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.385410] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-3a2fcef1-8595-4673-b288-f5996bf5062c taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.385410] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-3a2fcef1-8595-4673-b288-f5996bf5062c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.385787] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-3a2fcef1-8595-4673-b288-f5996bf5062c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.385935] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-3a2fcef1-8595-4673-b288-f5996bf5062c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.386185] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a2fcef1-8595-4673-b288-f5996bf5062c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.410909] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: SUCCESS [ 1110.411145] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.434837] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bec412e-0e1e-4a5b-8816-552633942519 in Status: SUCCESS [ 1110.435080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.497678] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.497892] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.497980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.498300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.498425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.498669] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.498794] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.498874] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.499075] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.499169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.499274] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd already deleted. [ 1110.499372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.720568] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.720767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.720890] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.721174] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.721393] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.721520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.721587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.721806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.721977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.722084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.722235] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.722331] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.722457] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.722659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.722826] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.722919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.722980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.723150] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.723227] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.723337] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.723475] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.776174] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.776393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.776464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.776653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.776836] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.776926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.776990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.777169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.777333] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.777409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.777588] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.777688] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.777768] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.777920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.778116] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.778212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.778269] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.778411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.778492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.778578] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.778665] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.888999] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.889293] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.889479] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.889863] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.890024] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.890204] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 3a2fcef1-8595-4673-b288-f5996bf5062c not found, creating... [ 1110.890494] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.890674] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.890823] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.891066] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.891233] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.891639] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.891917] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.892128] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.892479] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.892742] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.893166] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 3a2fcef1-8595-4673-b288-f5996bf5062c is going to be created. [ 1110.915427] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.915709] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.915851] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.916565] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.916806] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.917032] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-3a2fcef1-8595-4673-b288-f5996bf5062c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.225571] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8943f91-6f84-437f-912a-5f193b3365a6: rpc.has_security_group_logging(os_id): False [ 1111.256144] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.256318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.256363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.256576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.256668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.256859] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.256956] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.257031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.257187] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.257265] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.257461] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.257573] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.257618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.257753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.257827] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.258032] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.258126] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.258217] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.258322] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.258395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.258482] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8943f91-6f84-437f-912a-5f193b3365a6 is going to be created. [ 1111.281429] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c336180-c6d8-473b-8306-38646bd8e00e: rpc.has_security_group_logging(os_id): False [ 1111.283369] env[69343]: INFO networking_nsxv3.common.synchronization [req-70eed726-044c-4893-9eb8-63abce17349f req-cfe332be-d60c-4f85-a17d-53c50706d8a7 tempest-ImagesOneServerNegativeTestJSON-7986261 tempest-ImagesOneServerNegativeTestJSON-7986261-project-member] Enqueued Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1111.283983] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1111.284852] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.285034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.285034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.285246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.285395] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.285494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.285556] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.285789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.285873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.286084] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.302078] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.302220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.302295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.302507] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.302599] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.302788] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.302977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.303085] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.303372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.303480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.303715] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.303854] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.303921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.304088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.304193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.304351] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.304464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.304629] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.304777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.304875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.304984] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1111.328021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.328234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.328285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.328548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.328785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.340033] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: IN_PROGRESS for 2s [ 1111.372341] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.372527] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.372587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.373800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.373962] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.395121] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1111.596179] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-275 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.596179] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-275" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.596179] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-275" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.596179] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-275" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.596179] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.596179] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.596179] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.596849] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.597261] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.597652] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1111.597903] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.598160] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.598459] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.600853] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1111.600853] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.600853] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.621027] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.621027] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1111.621027] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.621027] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-275" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.621027] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-f91aa783-eaef-4047-94d3-bc9a0ade59e5 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.621027] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-f91aa783-eaef-4047-94d3-bc9a0ade59e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.621027] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-f91aa783-eaef-4047-94d3-bc9a0ade59e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.621027] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-f91aa783-eaef-4047-94d3-bc9a0ade59e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.621027] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f91aa783-eaef-4047-94d3-bc9a0ade59e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.790186] env[69343]: INFO networking_nsxv3.common.synchronization [req-55a062f7-13f3-4fbd-97e9-b247be919124 req-2140fd5f-6f33-4723-8d90-a5e479abcad8 service nova] Enqueued Resource ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd with Priority: HIGHEST for action security_group_rules [ 1111.790186] env[69343]: INFO networking_nsxv3.common.synchronization [req-55a062f7-13f3-4fbd-97e9-b247be919124 req-2140fd5f-6f33-4723-8d90-a5e479abcad8 service nova] Enqueued Resource ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd with Priority: HIGHEST for action security_group_members [ 1111.790186] env[69343]: INFO networking_nsxv3.common.synchronization [req-55a062f7-13f3-4fbd-97e9-b247be919124 req-2140fd5f-6f33-4723-8d90-a5e479abcad8 service nova] Enqueued Resource ID: 3a2fcef1-8595-4673-b288-f5996bf5062c with Priority: HIGHEST for action port [ 1111.790186] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.790186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.790186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.790186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.791126] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd with Priority: HIGHEST for action security_group_rules [ 1111.791410] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd with Priority: HIGHEST for action security_group_members [ 1111.791636] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a2fcef1-8595-4673-b288-f5996bf5062c with Priority: HIGHEST for action port [ 1111.795112] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-118b632b-56d4-49fc-a94f-fd72aafb1afd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.795112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.795112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.795112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.795112] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('118b632b-56d4-49fc-a94f-fd72aafb1afd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.795112] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-118b632b-56d4-49fc-a94f-fd72aafb1afd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.795112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.795112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.795112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.795112] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.795112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.795112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.795112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.795112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.795112] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('118b632b-56d4-49fc-a94f-fd72aafb1afd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.796471] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a2fcef1-8595-4673-b288-f5996bf5062c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.796734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a2fcef1-8595-4673-b288-f5996bf5062c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.798993] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a2fcef1-8595-4673-b288-f5996bf5062c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.798993] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a2fcef1-8595-4673-b288-f5996bf5062c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.798993] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a2fcef1-8595-4673-b288-f5996bf5062c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.823232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.823566] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.823707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.823777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.824331] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.824331] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.824331] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 is going to be updated. [ 1111.852946] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.852946] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.852946] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.852946] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.852946] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.862108] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: IN_PROGRESS for 2s [ 1112.122844] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.123099] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.123236] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.123616] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.123778] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.123940] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port f91aa783-eaef-4047-94d3-bc9a0ade59e5 not found, creating... [ 1112.124229] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.124452] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.124657] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.124948] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.125114] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.125410] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.125574] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.125719] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.125941] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.126096] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.126243] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: f91aa783-eaef-4047-94d3-bc9a0ade59e5 is going to be created. [ 1112.147690] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.147871] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.148012] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.148292] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.148524] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.148757] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-f91aa783-eaef-4047-94d3-bc9a0ade59e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.203140] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1112.203350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.299097] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-118b632b-56d4-49fc-a94f-fd72aafb1afd taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.299517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.299517] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('118b632b-56d4-49fc-a94f-fd72aafb1afd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.301243] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a2fcef1-8595-4673-b288-f5996bf5062c with status ACTIVE [ 1112.301243] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.301417] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.301487] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.301691] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.301781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.301969] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.302156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.302156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.302380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.302380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.302624] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.302687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.302687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.302833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.302889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.302976] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a2fcef1-8595-4673-b288-f5996bf5062c is going to be updated. [ 1112.342861] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.343045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.343239] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.343407] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.343593] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.343720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a2fcef1-8595-4673-b288-f5996bf5062c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.805245] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('118b632b-56d4-49fc-a94f-fd72aafb1afd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.863534] env[69343]: INFO networking_nsxv3.common.synchronization [req-70eed726-044c-4893-9eb8-63abce17349f req-db3d80b5-547e-4bf7-856e-9021de556ed1 service nova] Enqueued Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_rules [ 1112.864235] env[69343]: INFO networking_nsxv3.common.synchronization [req-70eed726-044c-4893-9eb8-63abce17349f req-db3d80b5-547e-4bf7-856e-9021de556ed1 service nova] Enqueued Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1112.864235] env[69343]: INFO networking_nsxv3.common.synchronization [req-70eed726-044c-4893-9eb8-63abce17349f req-db3d80b5-547e-4bf7-856e-9021de556ed1 service nova] Enqueued Resource ID: f91aa783-eaef-4047-94d3-bc9a0ade59e5 with Priority: HIGHEST for action port [ 1112.864942] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_rules [ 1112.865709] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1112.865709] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f91aa783-eaef-4047-94d3-bc9a0ade59e5 with Priority: HIGHEST for action port [ 1112.867020] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.867020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.867020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.867020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.867020] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.867849] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.868110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.868519] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-f91aa783-eaef-4047-94d3-bc9a0ade59e5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.868519] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f91aa783-eaef-4047-94d3-bc9a0ade59e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.869513] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f91aa783-eaef-4047-94d3-bc9a0ade59e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.869513] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f91aa783-eaef-4047-94d3-bc9a0ade59e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.869513] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f91aa783-eaef-4047-94d3-bc9a0ade59e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.307559] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.307932] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.307932] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.308022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.308078] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.308187] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd is going to be created. [ 1113.334462] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.334690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.334690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.334891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.335062] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.352207] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd in Status: UNINITIALIZED for 2s [ 1113.353093] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: SUCCESS [ 1113.353384] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.371150] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.371508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.371716] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f91aa783-eaef-4047-94d3-bc9a0ade59e5 with status ACTIVE [ 1113.374621] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.374621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.374621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.374621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.374621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.374621] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.374621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.374621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.374621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.374621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.374621] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.374621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.374621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.374621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.375834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.375834] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f91aa783-eaef-4047-94d3-bc9a0ade59e5 is going to be updated. [ 1113.403466] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.403651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.403690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.403974] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.404161] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.404354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f91aa783-eaef-4047-94d3-bc9a0ade59e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.408837] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1113.409063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.720315] env[69343]: INFO networking_nsxv3.common.synchronization [None req-83bf7e93-f6a1-4f6f-81b9-4d489bb2c399 tempest-AttachVolumeNegativeTest-1961671669 tempest-AttachVolumeNegativeTest-1961671669-project-member] Enqueued Resource ID: 052516cb-7b57-4fc8-95bb-1de193b1315b with Priority: HIGHEST for action security_group_rules [ 1113.720707] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 052516cb-7b57-4fc8-95bb-1de193b1315b with Priority: HIGHEST for action security_group_rules [ 1113.721063] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-052516cb-7b57-4fc8-95bb-1de193b1315b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.721219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.721614] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.721614] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.721739] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('052516cb-7b57-4fc8-95bb-1de193b1315b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.817638] env[69343]: INFO networking_nsxv3.common.synchronization [None req-a77d2046-db14-4e73-bc79-0bbfb0db0008 tempest-AttachVolumeNegativeTest-1961671669 tempest-AttachVolumeNegativeTest-1961671669-project-member] Enqueued Resource ID: 052516cb-7b57-4fc8-95bb-1de193b1315b with Priority: HIGHEST for action security_group_rules [ 1113.818494] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 052516cb-7b57-4fc8-95bb-1de193b1315b with Priority: HIGHEST for action security_group_rules [ 1113.818873] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-052516cb-7b57-4fc8-95bb-1de193b1315b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.819018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.874462] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: SUCCESS [ 1113.874462] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 deletion is rescheduled due to dependency. [ 1113.874809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.875321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.877021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.877021] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.877021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.877021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.877021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.877021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.877719] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.245680] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.245680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.245680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.245680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.245680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.245680] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 052516cb-7b57-4fc8-95bb-1de193b1315b already deleted. [ 1114.245680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.245680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.245680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.245680] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('052516cb-7b57-4fc8-95bb-1de193b1315b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.380380] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.563870] env[69343]: INFO networking_nsxv3.common.synchronization [req-94732a3a-6928-467c-8fcd-13b279277be1 req-7bc54f7e-92a5-4cdc-8fd6-0ca0a56bf031 tempest-ServersTestJSON-245111932 tempest-ServersTestJSON-245111932-project-member] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1114.565079] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1114.565079] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.565079] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.565079] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.567462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.567462] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.567462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.567462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.567462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.567462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.567462] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.769587] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.769587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.769587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.770063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.770063] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.770144] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 052516cb-7b57-4fc8-95bb-1de193b1315b already deleted. [ 1114.770220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.883438] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.070756] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.363134] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd in Status: SUCCESS [ 1115.363316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.363490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.363713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.367022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.367022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.367022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.367022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.367022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.367022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.367022] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('118b632b-56d4-49fc-a94f-fd72aafb1afd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.385846] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.386199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.386199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.386278] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.386368] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.386463] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 is going to be updated. [ 1115.421543] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.421769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.421815] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.422025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.422175] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.434032] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: IN_PROGRESS for 2s [ 1115.576601] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.716766] env[69343]: INFO networking_nsxv3.common.synchronization [req-1ca7adf0-24c7-4e31-80ed-4383bbecff59 req-c44390a2-b7ca-4967-ac37-5588850d46d8 tempest-ServerActionsTestOtherA-678333832 tempest-ServerActionsTestOtherA-678333832-project-member] Enqueued Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_members [ 1115.716766] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_members [ 1115.716766] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.716766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.716766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.716766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.716766] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.716766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.717091] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.717091] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.717091] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.717193] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.868559] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-118b632b-56d4-49fc-a94f-fd72aafb1afd taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.868762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.868805] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.871692] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.871903] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.872059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.872137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.872328] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.872435] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.872530] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.872691] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-118b632b-56d4-49fc-a94f-fd72aafb1afd taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.872786] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.872852] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.872995] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.873149] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.873313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.873313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.873480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.873578] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.875598] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.875733] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('118b632b-56d4-49fc-a94f-fd72aafb1afd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.055736] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-184 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.056237] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.056237] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.056506] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.056682] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.057670] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.057788] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.058063] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.058229] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.058457] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1116.058613] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.058696] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.058810] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.058927] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1116.059050] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.059195] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.082949] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.083153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.083222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.083513] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.083602] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.083710] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1116.087059] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.087235] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1116.087381] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.087557] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-184" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.087870] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-1988fe3d-4b66-49f8-9b8d-d0bf201531eb taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.088069] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-1988fe3d-4b66-49f8-9b8d-d0bf201531eb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.088200] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-1988fe3d-4b66-49f8-9b8d-d0bf201531eb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.088518] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-1988fe3d-4b66-49f8-9b8d-d0bf201531eb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.088668] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1988fe3d-4b66-49f8-9b8d-d0bf201531eb',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.118755] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.118755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.118755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.118755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.118755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.131688] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1116.221378] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.379432] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 118b632b-56d4-49fc-a94f-fd72aafb1afd: rpc.has_security_group_logging(os_id): False [ 1116.401159] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.401159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.401159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.401593] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.401593] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.401781] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.401922] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.401950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.402139] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.402215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.402399] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.402584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.402653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.402779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.402855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.403067] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.403164] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.403226] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.403415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.403499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.403592] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd is going to be created. [ 1116.477170] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.477402] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.477465] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.477715] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.477908] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.494810] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd in Status: IN_PROGRESS for 2s [ 1116.593374] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.593720] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.593950] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.594452] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.594724] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.595037] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 1988fe3d-4b66-49f8-9b8d-d0bf201531eb not found, creating... [ 1116.595603] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.595793] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.596036] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.596446] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.596705] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.597265] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.597552] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.597782] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.598225] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.598482] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.598767] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 1988fe3d-4b66-49f8-9b8d-d0bf201531eb is going to be created. [ 1116.628157] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.628157] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.628157] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.628439] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.628621] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.629166] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-1988fe3d-4b66-49f8-9b8d-d0bf201531eb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.723032] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.226534] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.226534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.226534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.226534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.226534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.226534] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc is going to be updated. [ 1117.256654] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.256654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.256654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.256654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.256654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.265462] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: IN_PROGRESS for 2s [ 1117.313475] env[69343]: INFO networking_nsxv3.common.synchronization [req-1ca7adf0-24c7-4e31-80ed-4383bbecff59 req-32484b7b-901a-4c71-bca5-fe81491258d7 service nova] Enqueued Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_rules [ 1117.313475] env[69343]: INFO networking_nsxv3.common.synchronization [req-1ca7adf0-24c7-4e31-80ed-4383bbecff59 req-32484b7b-901a-4c71-bca5-fe81491258d7 service nova] Enqueued Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_members [ 1117.313475] env[69343]: INFO networking_nsxv3.common.synchronization [req-1ca7adf0-24c7-4e31-80ed-4383bbecff59 req-32484b7b-901a-4c71-bca5-fe81491258d7 service nova] Enqueued Resource ID: 1988fe3d-4b66-49f8-9b8d-d0bf201531eb with Priority: HIGHEST for action port [ 1117.313475] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_rules [ 1117.313475] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_members [ 1117.313475] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1988fe3d-4b66-49f8-9b8d-d0bf201531eb with Priority: HIGHEST for action port [ 1117.313475] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.313475] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.313948] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.314438] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.314648] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.316942] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.317268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.317639] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-1988fe3d-4b66-49f8-9b8d-d0bf201531eb taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.318382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1988fe3d-4b66-49f8-9b8d-d0bf201531eb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.318382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1988fe3d-4b66-49f8-9b8d-d0bf201531eb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.318382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1988fe3d-4b66-49f8-9b8d-d0bf201531eb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.318382] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1988fe3d-4b66-49f8-9b8d-d0bf201531eb',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.443932] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: SUCCESS [ 1117.444199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.444346] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.444598] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.444799] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.444914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.444978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.445171] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.445274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.445368] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.445540] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.819745] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.819897] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.821260] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1988fe3d-4b66-49f8-9b8d-d0bf201531eb with status ACTIVE [ 1117.821462] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.821605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.821675] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.821884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.821974] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.822182] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.822293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.822355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.822496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.822581] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.822749] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.822831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.822896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.823054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.823241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.823241] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1988fe3d-4b66-49f8-9b8d-d0bf201531eb is going to be updated. [ 1117.846515] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.846743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.846743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.846950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.847069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.847238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1988fe3d-4b66-49f8-9b8d-d0bf201531eb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.948309] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.948647] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.948752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.949121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.949409] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.949637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.949721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.949960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.950080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.950247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.950499] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.950670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.950789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.951060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.951312] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.951578] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.951696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.951916] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.952045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.952170] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.952305] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.148613] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1118.148930] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.455248] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8: rpc.has_security_group_logging(os_id): False [ 1118.474820] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.475133] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.475263] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.475499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.475645] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.475808] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.476127] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.476198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.476372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.476453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.476670] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.476775] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.476841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.476982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.477071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.477261] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.477345] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.477409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.477546] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.477622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.477708] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 is going to be updated. [ 1118.509847] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd in Status: SUCCESS [ 1118.510110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.545613] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.545613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.545613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.545613] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.545910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.559381] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: IN_PROGRESS for 2s [ 1119.276182] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: SUCCESS [ 1119.276182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.276182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.276182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.276182] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.276357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.276357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.277024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.277024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.277024] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.590435] env[69343]: INFO networking_nsxv3.common.synchronization [req-7494e0fd-9b6c-4f08-a6c4-bd696f55c505 req-70bfd49c-f925-449c-bf5c-8aa991e86f43 tempest-ServerActionsTestOtherB-1339566970 tempest-ServerActionsTestOtherB-1339566970-project-member] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 1119.590789] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 1119.591095] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.591239] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.591443] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.591609] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.591706] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.591822] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.591904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.591993] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.592714] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.592842] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.778933] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.920340] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-551 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.920340] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-551" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.920340] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-551" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.920340] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-551" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.920340] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.920688] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.920688] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.921083] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.921083] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.921232] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1119.922038] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1119.922038] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1119.922038] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1119.922038] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1119.922038] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1119.922038] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1119.943980] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1119.944160] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1119.944311] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1119.944606] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-551" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.944934] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-171fa31b-ba9b-49f3-9f39-d36d3260bda9 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.945130] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-171fa31b-ba9b-49f3-9f39-d36d3260bda9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.945257] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-171fa31b-ba9b-49f3-9f39-d36d3260bda9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.945660] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-171fa31b-ba9b-49f3-9f39-d36d3260bda9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.945813] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('171fa31b-ba9b-49f3-9f39-d36d3260bda9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.094668] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.095019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.095019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.095390] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.095499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.095796] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.096011] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.096011] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.096355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.096521] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.096671] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 is going to be deleted. [ 1120.128925] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.129167] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.130050] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.130050] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.130050] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.130050] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.281162] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.449142] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.449142] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.449142] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.449142] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.449547] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.449547] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 171fa31b-ba9b-49f3-9f39-d36d3260bda9 not found, creating... [ 1120.449642] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.449778] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.449903] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.450199] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.450405] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.450778] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.450958] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.451108] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.451336] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.451506] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.451665] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 171fa31b-ba9b-49f3-9f39-d36d3260bda9 is going to be created. [ 1120.474247] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.474551] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.474617] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.474858] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.475109] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.475342] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-171fa31b-ba9b-49f3-9f39-d36d3260bda9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.577526] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: SUCCESS [ 1120.577653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.783596] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.784095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.784095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.784095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.784275] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.784319] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc is going to be updated. [ 1120.815435] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.815608] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.815643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.815882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.816047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.830527] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: IN_PROGRESS for 2s [ 1121.177052] env[69343]: INFO networking_nsxv3.common.synchronization [req-7494e0fd-9b6c-4f08-a6c4-bd696f55c505 req-c69aeb9a-516a-4962-9873-16f4e7c259fc service nova] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_rules [ 1121.177231] env[69343]: INFO networking_nsxv3.common.synchronization [req-7494e0fd-9b6c-4f08-a6c4-bd696f55c505 req-c69aeb9a-516a-4962-9873-16f4e7c259fc service nova] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 1121.177408] env[69343]: INFO networking_nsxv3.common.synchronization [req-7494e0fd-9b6c-4f08-a6c4-bd696f55c505 req-c69aeb9a-516a-4962-9873-16f4e7c259fc service nova] Enqueued Resource ID: 171fa31b-ba9b-49f3-9f39-d36d3260bda9 with Priority: HIGHEST for action port [ 1121.178204] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_rules [ 1121.178426] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 1121.178476] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171fa31b-ba9b-49f3-9f39-d36d3260bda9 with Priority: HIGHEST for action port [ 1121.178780] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.178909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.179040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.179184] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.179269] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.180412] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.180548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.180668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.180851] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.180988] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.181103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.181169] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.181381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.181483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.181583] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.187223] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-171fa31b-ba9b-49f3-9f39-d36d3260bda9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.187223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-171fa31b-ba9b-49f3-9f39-d36d3260bda9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.187223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-171fa31b-ba9b-49f3-9f39-d36d3260bda9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.187223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-171fa31b-ba9b-49f3-9f39-d36d3260bda9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.187223] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('171fa31b-ba9b-49f3-9f39-d36d3260bda9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.688063] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.689204] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.690064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.690064] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 171fa31b-ba9b-49f3-9f39-d36d3260bda9 with status ACTIVE [ 1121.690064] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.690064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.690064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.690397] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.690397] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.690580] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.690684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.690745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.690904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.690980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.691372] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.691372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.691372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.691489] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.691516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.692073] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 171fa31b-ba9b-49f3-9f39-d36d3260bda9 is going to be updated. [ 1121.715650] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.715820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.716044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.716398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.716622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.716795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-171fa31b-ba9b-49f3-9f39-d36d3260bda9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.974196] env[69343]: INFO networking_nsxv3.common.synchronization [req-75977fec-8930-43c0-9ce5-592222a8ec10 req-a290a9fb-30e7-4286-b3fc-e7c88363eea3 tempest-ServerActionsTestJSON-1397784852 tempest-ServerActionsTestJSON-1397784852-project-member] Enqueued Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 1121.974196] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 1121.975513] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.975953] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.976227] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.976565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.977248] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.977590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.977875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.980020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.980020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.980020] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.191311] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.316361] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.316606] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-988" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.316793] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-988" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.317124] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-988" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.317433] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.317644] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.317961] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.318112] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.318309] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.318573] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1122.318733] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.318850] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.319039] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.319166] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1122.319416] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.319563] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.338892] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.339078] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1122.339225] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.339426] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-988" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.339729] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.339907] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.340045] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.340393] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.340612] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.481395] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.481585] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.481688] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.481919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.503796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.504042] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.504172] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.504242] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.504452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.504882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.504882] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 is going to be updated. [ 1122.530139] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.530291] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.530383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.530606] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.530894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.541639] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: IN_PROGRESS for 2s [ 1122.695851] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.698391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.698391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.698391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.698391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.698391] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 is going to be created. [ 1122.728855] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.728855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.728855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.728855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.728855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.737922] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: UNINITIALIZED for 2s [ 1122.807480] env[69343]: INFO networking_nsxv3.common.synchronization [req-d201da1d-d22a-47bb-bf48-9ba05b11fc2c req-dbc294fb-5db0-4bcf-8939-9e1588a74ae7 tempest-ServerGroupTestJSON-1243996989 tempest-ServerGroupTestJSON-1243996989-project-member] Enqueued Resource ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd with Priority: HIGHEST for action security_group_members [ 1122.808820] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd with Priority: HIGHEST for action security_group_members [ 1122.809250] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-118b632b-56d4-49fc-a94f-fd72aafb1afd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.809437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.809547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.809782] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.809996] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.810173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.810282] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.810520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.810705] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.810885] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('118b632b-56d4-49fc-a94f-fd72aafb1afd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.844075] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.844441] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.844633] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.844968] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.845106] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.845269] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6 not found, creating... [ 1122.845552] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.845724] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.845862] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.846186] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.846331] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.846733] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.846952] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.847146] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.847705] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.847705] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.847705] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6 is going to be created. [ 1122.849587] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: SUCCESS [ 1122.849807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.849969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.850144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.850304] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.850404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.850466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.851137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.851311] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.851457] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.851562] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.875850] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.876105] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.876242] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.876525] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.876762] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.876995] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.316667] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.316667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.316667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.316667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.316667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.316667] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.316667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.316667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.316667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.316667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.316667] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd is going to be updated. [ 1123.347579] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.347579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.347579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.347579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.347579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.354143] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.359980] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd in Status: IN_PROGRESS for 2s [ 1123.512985] env[69343]: INFO networking_nsxv3.common.synchronization [req-09f86e2f-4dae-4019-b801-8a3ab012117e req-b1ecbd9b-8695-4b8e-89c4-64548acc2afd tempest-ImagesOneServerNegativeTestJSON-7986261 tempest-ImagesOneServerNegativeTestJSON-7986261-project-member] Enqueued Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1123.513981] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 with Priority: HIGHEST for action security_group_members [ 1123.514410] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.514634] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.514901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.515239] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.515481] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.515667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.515827] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.516084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.516252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.516430] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.585438] env[69343]: INFO networking_nsxv3.common.synchronization [req-75977fec-8930-43c0-9ce5-592222a8ec10 req-8116afca-3b81-4ba3-997d-eddd0b8a272c service nova] Enqueued Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_rules [ 1123.585976] env[69343]: INFO networking_nsxv3.common.synchronization [req-75977fec-8930-43c0-9ce5-592222a8ec10 req-8116afca-3b81-4ba3-997d-eddd0b8a272c service nova] Enqueued Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 1123.585976] env[69343]: INFO networking_nsxv3.common.synchronization [req-75977fec-8930-43c0-9ce5-592222a8ec10 req-8116afca-3b81-4ba3-997d-eddd0b8a272c service nova] Enqueued Resource ID: 3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6 with Priority: HIGHEST for action port [ 1123.586707] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_rules [ 1123.586707] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 1123.586707] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6 with Priority: HIGHEST for action port [ 1123.586918] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.586918] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.586918] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.587574] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.587691] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.590368] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.590502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.590797] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.590929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.591031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.591283] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.591376] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.866423] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc: rpc.has_security_group_logging(os_id): False [ 1123.889215] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.889215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.889215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.889215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.889215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.889698] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.889698] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.889815] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.890342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.890342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.890342] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc is going to be updated. [ 1123.965760] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.965909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.965982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.966202] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.966353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.979210] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: IN_PROGRESS for 2s [ 1124.019836] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.020057] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.020140] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.020408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.020523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.020799] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.020914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.021022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.021299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.021299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.021396] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 is going to be updated. [ 1124.083439] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.083636] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.083678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.083887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.084046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.093096] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.093278] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.094954] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6 with status ACTIVE [ 1124.095282] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.095403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.095472] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.096046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.096046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.096046] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.096249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.096349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.096608] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.096779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.097068] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.097799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.097799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.097799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.097799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.097799] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6 is going to be updated. [ 1124.099548] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: IN_PROGRESS for 2s [ 1124.122912] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.123067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.123142] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.123356] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.123555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.123850] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c925a48-8ba1-40ca-a1fa-0a523bfe6ae6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.552535] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: SUCCESS [ 1124.552535] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 deletion is rescheduled due to dependency. [ 1124.553153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.553153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.553153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.553353] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.553353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.553499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.553575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.553667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.553767] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.751719] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: SUCCESS [ 1124.751944] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.752201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.752424] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.752619] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.752743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.752862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.752971] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.753067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.753237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.753237] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.057436] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.259478] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.372011] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd in Status: SUCCESS [ 1125.372242] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 118b632b-56d4-49fc-a94f-fd72aafb1afd deletion is rescheduled due to dependency. [ 1125.372402] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118b632b-56d4-49fc-a94f-fd72aafb1afd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.560348] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.760845] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 970edbb8-6a58-46c8-ad52-fe607c6c28e9: rpc.has_security_group_logging(os_id): False [ 1125.782546] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.782734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.782855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.783193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.783348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.783779] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.783921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.784022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.784267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.784383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.784506] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 is going to be created. [ 1125.843699] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.843699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.843699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.843873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.844069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.858608] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: IN_PROGRESS for 2s [ 1126.002022] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: SUCCESS [ 1126.002322] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.062563] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.062792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.062916] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.063162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.063258] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.063359] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 is going to be updated. [ 1126.094621] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.094782] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.094882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.095119] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.095260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.106043] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: IN_PROGRESS for 2s [ 1126.107468] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 in Status: SUCCESS [ 1126.107705] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8 deletion is rescheduled due to dependency. [ 1126.107821] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.140685] env[69343]: INFO networking_nsxv3.common.synchronization [req-ddc5796e-1e40-43cc-b557-7356ded8a8d2 req-450cac6b-9fb7-410b-a8c7-4f8276a61627 tempest-AttachVolumeNegativeTest-1961671669 tempest-AttachVolumeNegativeTest-1961671669-project-member] Enqueued Resource ID: 052516cb-7b57-4fc8-95bb-1de193b1315b with Priority: HIGHEST for action security_group_members [ 1126.141231] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 052516cb-7b57-4fc8-95bb-1de193b1315b with Priority: HIGHEST for action security_group_members [ 1126.141556] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-052516cb-7b57-4fc8-95bb-1de193b1315b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.141679] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.141747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.142009] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.143212] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.143395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.143467] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.143674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.143761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.143908] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('052516cb-7b57-4fc8-95bb-1de193b1315b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.423637] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-837 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.423860] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-837" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.423991] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-837" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.424279] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-837" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.424555] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.424736] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.424861] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.425110] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.425262] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.425475] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1126.425591] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1126.426184] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1126.426184] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1126.426184] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1126.426184] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1126.426357] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1126.445929] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1126.446127] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1126.446274] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1126.446451] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-837" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.446790] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-706726d7-d2e8-4485-a92f-fd63bc162263 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.446968] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-706726d7-d2e8-4485-a92f-fd63bc162263" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.447122] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-706726d7-d2e8-4485-a92f-fd63bc162263" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.447492] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-706726d7-d2e8-4485-a92f-fd63bc162263" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.447680] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('706726d7-d2e8-4485-a92f-fd63bc162263',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.646477] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.646843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.646882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.647261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.647450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.647834] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.648072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.648191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.648520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.648707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.648901] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 052516cb-7b57-4fc8-95bb-1de193b1315b already deleted. [ 1126.649068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.953080] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.953080] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.953080] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.953080] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.953080] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.953080] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 706726d7-d2e8-4485-a92f-fd63bc162263 not found, creating... [ 1126.953080] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.953080] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.953080] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.953080] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.953080] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.953587] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.953587] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.953587] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.953587] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.953833] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.954053] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 706726d7-d2e8-4485-a92f-fd63bc162263 is going to be created. [ 1126.976915] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.977324] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.977652] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.978121] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.978525] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.978900] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-706726d7-d2e8-4485-a92f-fd63bc162263" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.342256] env[69343]: INFO networking_nsxv3.common.synchronization [req-042a8ea9-8ac2-4050-accb-b5da7abbbb73 req-15b5900b-02c0-4a3d-ac9b-a5d1895927c9 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1127.342795] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1127.343912] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.344127] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.344245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.344488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.344698] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.344861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.344961] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.345163] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.345300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.345462] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.685057] env[69343]: INFO networking_nsxv3.common.synchronization [req-ddc5796e-1e40-43cc-b557-7356ded8a8d2 req-7317fffe-7f96-47e6-9194-b9fb551a8e52 service nova] Enqueued Resource ID: 052516cb-7b57-4fc8-95bb-1de193b1315b with Priority: HIGHEST for action security_group_rules [ 1127.685442] env[69343]: INFO networking_nsxv3.common.synchronization [req-ddc5796e-1e40-43cc-b557-7356ded8a8d2 req-7317fffe-7f96-47e6-9194-b9fb551a8e52 service nova] Enqueued Resource ID: 052516cb-7b57-4fc8-95bb-1de193b1315b with Priority: HIGHEST for action security_group_members [ 1127.688516] env[69343]: INFO networking_nsxv3.common.synchronization [req-ddc5796e-1e40-43cc-b557-7356ded8a8d2 req-7317fffe-7f96-47e6-9194-b9fb551a8e52 service nova] Enqueued Resource ID: 706726d7-d2e8-4485-a92f-fd63bc162263 with Priority: HIGHEST for action port [ 1127.688516] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 052516cb-7b57-4fc8-95bb-1de193b1315b with Priority: HIGHEST for action security_group_rules [ 1127.688516] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 052516cb-7b57-4fc8-95bb-1de193b1315b with Priority: HIGHEST for action security_group_members [ 1127.688516] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 706726d7-d2e8-4485-a92f-fd63bc162263 with Priority: HIGHEST for action port [ 1127.688875] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-052516cb-7b57-4fc8-95bb-1de193b1315b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.689135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.689326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.689697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.689893] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('052516cb-7b57-4fc8-95bb-1de193b1315b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.692470] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-052516cb-7b57-4fc8-95bb-1de193b1315b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.692695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.692988] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.693521] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.694106] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.694445] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.694557] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.694816] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.695086] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.695281] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('052516cb-7b57-4fc8-95bb-1de193b1315b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.696206] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-706726d7-d2e8-4485-a92f-fd63bc162263 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.696814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-706726d7-d2e8-4485-a92f-fd63bc162263" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.696950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-706726d7-d2e8-4485-a92f-fd63bc162263" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.697173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-706726d7-d2e8-4485-a92f-fd63bc162263" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.697309] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('706726d7-d2e8-4485-a92f-fd63bc162263',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.746487] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.746690] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.746864] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.747134] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.747372] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.747521] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.747649] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.747998] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.748462] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.748799] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.749038] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.749227] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.749442] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.749653] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.750222] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.750222] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.769812] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.770054] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1127.770314] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.770600] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.771403] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-cc4c9a96-b87e-4f84-bc47-d2f600631452 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.771403] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-cc4c9a96-b87e-4f84-bc47-d2f600631452" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.771790] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-cc4c9a96-b87e-4f84-bc47-d2f600631452" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.772209] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-cc4c9a96-b87e-4f84-bc47-d2f600631452" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.772316] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc4c9a96-b87e-4f84-bc47-d2f600631452',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.847458] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.847633] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.847687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.847957] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.874963] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.875539] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.875703] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.875762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.876028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.876123] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.876223] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be updated. [ 1127.878830] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: SUCCESS [ 1127.878830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.905548] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.905798] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.905798] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.905955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.906120] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.916932] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: IN_PROGRESS for 2s [ 1128.117296] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: SUCCESS [ 1128.117589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.117724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.117916] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.118141] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.118419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.118419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.118495] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.118588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.118676] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.118831] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.193971] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-052516cb-7b57-4fc8-95bb-1de193b1315b taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.193971] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.200980] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('052516cb-7b57-4fc8-95bb-1de193b1315b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.201988] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 706726d7-d2e8-4485-a92f-fd63bc162263 with status ACTIVE [ 1128.202458] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.202458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.202458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.202652] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.202689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.203144] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.203144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.203144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.203316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.203316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.204105] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.204105] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.204105] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.204105] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.204105] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.204105] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 706726d7-d2e8-4485-a92f-fd63bc162263 is going to be updated. [ 1128.244829] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.245036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.245036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.245917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.245917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.245917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-706726d7-d2e8-4485-a92f-fd63bc162263" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.275847] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.276138] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.276276] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.276571] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.276734] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.277265] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port cc4c9a96-b87e-4f84-bc47-d2f600631452 not found, creating... [ 1128.277265] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.277394] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.277572] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.277737] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.277882] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.278377] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.278377] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.278879] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.279158] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.279392] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.279464] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: cc4c9a96-b87e-4f84-bc47-d2f600631452 is going to be created. [ 1128.324388] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.324574] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.325135] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.325135] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.325280] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.325501] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-cc4c9a96-b87e-4f84-bc47-d2f600631452" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.489237] env[69343]: INFO networking_nsxv3.common.synchronization [req-debd4ca1-0a2c-4055-ae24-a8356305c029 req-6fbe7ab1-2c42-4e65-b058-13a4f67ea99e tempest-ServersNegativeTestJSON-949345807 tempest-ServersNegativeTestJSON-949345807-project-member] Enqueued Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_members [ 1128.489872] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_members [ 1128.490567] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.490567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.490567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.490567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.490775] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.490861] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.490906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.493682] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.496563] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.496724] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.621061] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.706369] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('052516cb-7b57-4fc8-95bb-1de193b1315b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.797424] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-109 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.797624] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-109" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.797755] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-109" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.798029] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-109" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.798294] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.798455] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.798576] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.798799] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.799611] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.799863] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1128.799998] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1128.800130] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1128.800248] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1128.800364] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1128.800476] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1128.800612] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1128.820681] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1128.822800] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1128.822800] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1128.822800] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-109" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.822800] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-ad123d4c-9922-4621-94ee-ea0b9046fbf9 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.822800] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-ad123d4c-9922-4621-94ee-ea0b9046fbf9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.822800] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-ad123d4c-9922-4621-94ee-ea0b9046fbf9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.822800] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-ad123d4c-9922-4621-94ee-ea0b9046fbf9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.822800] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad123d4c-9922-4621-94ee-ea0b9046fbf9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.999187] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.123764] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ceec863-0a7a-401b-a8e8-048823180971: rpc.has_security_group_logging(os_id): False [ 1129.142215] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.142643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.142643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.142643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.142815] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.142964] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.143078] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.143137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.143258] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.143329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.143417] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 is going to be updated. [ 1129.157186] env[69343]: INFO networking_nsxv3.common.synchronization [req-042a8ea9-8ac2-4050-accb-b5da7abbbb73 req-1d8270a1-0de5-4a24-be1d-891b449049dd service nova] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_rules [ 1129.157376] env[69343]: INFO networking_nsxv3.common.synchronization [req-042a8ea9-8ac2-4050-accb-b5da7abbbb73 req-1d8270a1-0de5-4a24-be1d-891b449049dd service nova] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1129.157528] env[69343]: INFO networking_nsxv3.common.synchronization [req-042a8ea9-8ac2-4050-accb-b5da7abbbb73 req-1d8270a1-0de5-4a24-be1d-891b449049dd service nova] Enqueued Resource ID: cc4c9a96-b87e-4f84-bc47-d2f600631452 with Priority: HIGHEST for action port [ 1129.158034] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_rules [ 1129.158181] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1129.158287] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc4c9a96-b87e-4f84-bc47-d2f600631452 with Priority: HIGHEST for action port [ 1129.158571] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.158694] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.158766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.158964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.163128] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.164082] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.164226] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.164389] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc4c9a96-b87e-4f84-bc47-d2f600631452 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.164500] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc4c9a96-b87e-4f84-bc47-d2f600631452" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.164552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc4c9a96-b87e-4f84-bc47-d2f600631452" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.164735] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc4c9a96-b87e-4f84-bc47-d2f600631452" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.164811] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc4c9a96-b87e-4f84-bc47-d2f600631452',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.207471] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.207728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.207728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.207941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.208108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.211917] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.212073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.212126] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.212305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.212392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.212489] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 052516cb-7b57-4fc8-95bb-1de193b1315b is going to be created. [ 1129.224711] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: IN_PROGRESS for 2s [ 1129.235925] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.236118] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.236175] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.236418] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.236581] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.246894] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 052516cb-7b57-4fc8-95bb-1de193b1315b in Status: UNINITIALIZED for 2s [ 1129.327425] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.327658] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.327939] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.328329] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.328521] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.328721] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port ad123d4c-9922-4621-94ee-ea0b9046fbf9 not found, creating... [ 1129.329054] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.329241] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.329387] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.329650] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.329837] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.330236] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.330389] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.330551] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.330807] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.330980] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.331396] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: ad123d4c-9922-4621-94ee-ea0b9046fbf9 is going to be created. [ 1129.355195] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.355693] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.355836] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.356287] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.356544] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.356780] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-ad123d4c-9922-4621-94ee-ea0b9046fbf9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.501292] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.666409] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.666617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.666765] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc4c9a96-b87e-4f84-bc47-d2f600631452 with status ACTIVE [ 1129.666957] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.667085] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.667161] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.667380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.667492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.667952] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.668282] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.668282] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.668405] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.668520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.668748] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.668748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.668943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.669035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.669117] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.669190] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc4c9a96-b87e-4f84-bc47-d2f600631452 is going to be updated. [ 1129.712524] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.712524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.712524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.712524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.712524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.712524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc4c9a96-b87e-4f84-bc47-d2f600631452" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.928034] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1129.928034] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 deletion is rescheduled due to dependency. [ 1129.928034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.928034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.928034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.928321] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.928321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.928321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.928428] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.928476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.928580] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.004024] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.004184] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.004258] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.004476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.004595] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.004698] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8943f91-6f84-437f-912a-5f193b3365a6 is going to be updated. [ 1130.045696] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.045911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.045911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.046065] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.046205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.056316] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: IN_PROGRESS for 2s [ 1130.063732] env[69343]: INFO networking_nsxv3.common.synchronization [req-debd4ca1-0a2c-4055-ae24-a8356305c029 req-f5fc7cb1-8da0-48ed-aff7-41f1d25785fd service nova] Enqueued Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_rules [ 1130.063915] env[69343]: INFO networking_nsxv3.common.synchronization [req-debd4ca1-0a2c-4055-ae24-a8356305c029 req-f5fc7cb1-8da0-48ed-aff7-41f1d25785fd service nova] Enqueued Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_members [ 1130.064107] env[69343]: INFO networking_nsxv3.common.synchronization [req-debd4ca1-0a2c-4055-ae24-a8356305c029 req-f5fc7cb1-8da0-48ed-aff7-41f1d25785fd service nova] Enqueued Resource ID: ad123d4c-9922-4621-94ee-ea0b9046fbf9 with Priority: HIGHEST for action port [ 1130.064791] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_rules [ 1130.064940] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_members [ 1130.065102] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad123d4c-9922-4621-94ee-ea0b9046fbf9 with Priority: HIGHEST for action port [ 1130.065413] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.065550] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.065634] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.065903] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.065994] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.066972] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.067157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.067407] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad123d4c-9922-4621-94ee-ea0b9046fbf9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.067523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad123d4c-9922-4621-94ee-ea0b9046fbf9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.067591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad123d4c-9922-4621-94ee-ea0b9046fbf9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.067799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad123d4c-9922-4621-94ee-ea0b9046fbf9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.067881] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad123d4c-9922-4621-94ee-ea0b9046fbf9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.381332] env[69343]: INFO networking_nsxv3.common.synchronization [req-e10da38f-e58e-4beb-af07-671def42a75b req-283e7a8f-2a3c-474c-b37d-08ae9aa530c0 tempest-DeleteServersTestJSON-1417757124 tempest-DeleteServersTestJSON-1417757124-project-member] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1130.383955] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1130.383955] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.384076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.384179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.384825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.386459] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.386459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.386459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.386459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.386459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.386459] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.430500] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.569666] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.569784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.572260] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad123d4c-9922-4621-94ee-ea0b9046fbf9 with status ACTIVE [ 1130.572539] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.572677] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.572810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.572963] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.573099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.573246] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.573345] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.573411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.573621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.573713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.573946] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.574061] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.574129] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.574289] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.574367] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.574455] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad123d4c-9922-4621-94ee-ea0b9046fbf9 is going to be updated. [ 1130.598811] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.598974] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.599054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.599282] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.599420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.599580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad123d4c-9922-4621-94ee-ea0b9046fbf9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.693291] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-284 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.695020] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.695020] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.695020] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.695020] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.695020] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.695551] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.696147] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.699149] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.699149] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.699149] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.699149] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.699149] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.699149] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.699149] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.699149] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.720238] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.720238] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1130.720238] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.720238] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.720238] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-9ddf75fe-4fc9-44b3-80af-3be0a9e47243 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.720238] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-9ddf75fe-4fc9-44b3-80af-3be0a9e47243" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.720238] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-9ddf75fe-4fc9-44b3-80af-3be0a9e47243" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.720238] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-9ddf75fe-4fc9-44b3-80af-3be0a9e47243" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.720238] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ddf75fe-4fc9-44b3-80af-3be0a9e47243',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.889964] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.890365] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.890365] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.890522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.890622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.890821] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.890951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.891031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.891198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.891277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.891367] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1130.918233] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.918420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.918466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.918641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.918787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.929468] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1130.932869] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.222812] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.223270] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.223525] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.223936] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.224177] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.224394] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 9ddf75fe-4fc9-44b3-80af-3be0a9e47243 not found, creating... [ 1131.224754] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.224965] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.225157] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.225476] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.225654] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.225969] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.226148] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.226283] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.226510] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.226652] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.226800] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 9ddf75fe-4fc9-44b3-80af-3be0a9e47243 is going to be created. [ 1131.257245] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: SUCCESS [ 1131.257463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.258289] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 052516cb-7b57-4fc8-95bb-1de193b1315b in Status: SUCCESS [ 1131.258512] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.258628] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.258854] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.259077] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.259197] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.259259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.259450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.259600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.259600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.259730] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('052516cb-7b57-4fc8-95bb-1de193b1315b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.266845] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.267131] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.267214] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.267472] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.267753] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.268069] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-9ddf75fe-4fc9-44b3-80af-3be0a9e47243" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.434950] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.435207] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.435345] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.435683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.435832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.435957] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be updated. [ 1131.476430] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.476785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.478506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.478506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.478506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.493228] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: IN_PROGRESS for 2s [ 1131.762802] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('052516cb-7b57-4fc8-95bb-1de193b1315b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.067977] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: SUCCESS [ 1132.068234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.068412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.068731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.068831] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.068952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.069023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.069174] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.069667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.069667] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.268010] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 052516cb-7b57-4fc8-95bb-1de193b1315b: rpc.has_security_group_logging(os_id): False [ 1132.288494] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.288494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.288494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.288494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.288494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.288879] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.288879] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.288879] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.288879] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.289099] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.289099] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 052516cb-7b57-4fc8-95bb-1de193b1315b is going to be created. [ 1132.346658] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.346850] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.346897] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.347102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.347293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.361358] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 052516cb-7b57-4fc8-95bb-1de193b1315b in Status: IN_PROGRESS for 2s [ 1132.425052] env[69343]: INFO networking_nsxv3.common.synchronization [req-e10da38f-e58e-4beb-af07-671def42a75b req-5bf580e4-25ef-4f4d-a433-49b0713b705e service nova] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_rules [ 1132.425251] env[69343]: INFO networking_nsxv3.common.synchronization [req-e10da38f-e58e-4beb-af07-671def42a75b req-5bf580e4-25ef-4f4d-a433-49b0713b705e service nova] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1132.425393] env[69343]: INFO networking_nsxv3.common.synchronization [req-e10da38f-e58e-4beb-af07-671def42a75b req-5bf580e4-25ef-4f4d-a433-49b0713b705e service nova] Enqueued Resource ID: 9ddf75fe-4fc9-44b3-80af-3be0a9e47243 with Priority: HIGHEST for action port [ 1132.425650] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_rules [ 1132.425831] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1132.425933] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ddf75fe-4fc9-44b3-80af-3be0a9e47243 with Priority: HIGHEST for action port [ 1132.426516] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.426649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.426899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.426970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.427011] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.428110] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.428215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.428418] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ddf75fe-4fc9-44b3-80af-3be0a9e47243 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.428532] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ddf75fe-4fc9-44b3-80af-3be0a9e47243" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.428605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ddf75fe-4fc9-44b3-80af-3be0a9e47243" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.429245] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ddf75fe-4fc9-44b3-80af-3be0a9e47243" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.429245] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ddf75fe-4fc9-44b3-80af-3be0a9e47243',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.572462] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.932381] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ddf75fe-4fc9-44b3-80af-3be0a9e47243 with status ACTIVE [ 1132.932381] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.932381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.932381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.932381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.932381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.932844] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.932844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.932844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.932941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.932968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.934152] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.934152] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.934152] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.934152] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.934152] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.934152] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ddf75fe-4fc9-44b3-80af-3be0a9e47243 is going to be updated. [ 1132.935189] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.935361] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.945413] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1132.945413] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e deletion is rescheduled due to dependency. [ 1132.945413] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.945413] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.945718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.945968] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.946199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.946303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.946717] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.946844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.946976] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.956697] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.956839] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.956923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.957127] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.957305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.957474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ddf75fe-4fc9-44b3-80af-3be0a9e47243" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.075746] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.449539] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.502528] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1133.502966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.503096] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.503395] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.503671] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.504386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.504386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.504386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.504386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.504386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.504674] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.578289] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.578464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.578534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.578747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.578844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.578944] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8943f91-6f84-437f-912a-5f193b3365a6 is going to be updated. [ 1133.637213] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.637363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.637423] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.637996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.637996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.658031] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: IN_PROGRESS for 2s [ 1133.952025] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.007454] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.007764] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.007764] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.007941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.008149] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.008296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.008375] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.008571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.008673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.008759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.008918] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.009129] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.009129] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.009298] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.009494] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.009637] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.009713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.009983] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.010205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.010205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.010205] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.122503] env[69343]: INFO networking_nsxv3.common.synchronization [None req-94d6337e-bca7-45f2-a199-b093c3a7c974 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1134.123673] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1134.123673] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.125029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.125029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.125029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.125029] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.125029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.125029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.125029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.125708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.125708] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.375924] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 052516cb-7b57-4fc8-95bb-1de193b1315b in Status: SUCCESS [ 1134.375924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.455512] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.455728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.455885] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.456102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.456228] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.456363] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1134.490554] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.490831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.490894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.491226] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.491452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.502947] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1134.512591] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e6e2d6-f175-4be9-be9a-bdb1208e0e04: rpc.has_security_group_logging(os_id): False [ 1134.535284] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.535526] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.535670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.536024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.536189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.536544] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.536720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.536830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.538724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.538889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.539269] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.539420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.539527] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.539789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.539910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.540229] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.540425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.540523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.540736] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.540863] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.541021] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be updated. [ 1134.631303] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.634182] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.634450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.634450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.634681] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.634857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.671028] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: IN_PROGRESS for 2s [ 1135.137024] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.646547] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.646547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.646547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.646547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.646547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.646547] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be updated. [ 1135.664813] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: SUCCESS [ 1135.667028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.667028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.667028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.667028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.667028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.667028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.667028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.667028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.667028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.667028] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.680018] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.680182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.680254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.680485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.680731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.690859] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: IN_PROGRESS for 2s [ 1136.171522] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.172645] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.172875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.173132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.173325] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.173441] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.173503] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.173668] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.173762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.173851] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.174022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.174143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.174199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.174318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.174700] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.174700] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.174700] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.174876] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.174876] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.174876] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.175063] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.514274] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1136.514709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.514709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.515044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.515158] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.515359] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.515359] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.515680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.515776] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.515857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.515951] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.607441] env[69343]: INFO networking_nsxv3.common.synchronization [req-d66cf30d-3a21-4a70-815c-c7228df0fb61 req-73d5795b-e30c-454c-9b15-f1ff089dc925 tempest-ServersTestJSON-245111932 tempest-ServersTestJSON-245111932-project-member] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1136.607983] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1136.608302] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.608515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.608515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.608753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.608913] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.609052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.609101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.609231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.609317] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.609407] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.678692] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8943f91-6f84-437f-912a-5f193b3365a6: rpc.has_security_group_logging(os_id): False [ 1136.690012] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1136.690012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.698310] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.698588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.698588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.698743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.699062] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.699277] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.699378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.699435] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.699599] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.699681] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.699875] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.699967] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.700041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.700184] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.700257] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.700447] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.700537] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.700589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.700725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.700798] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.700880] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8943f91-6f84-437f-912a-5f193b3365a6 is going to be updated. [ 1136.762402] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.762581] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.762657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.763455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.763455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.777644] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: IN_PROGRESS for 2s [ 1136.934337] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.934573] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.934795] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.935280] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.935961] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.936144] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.936494] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.936825] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.938166] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.938166] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1136.938438] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1136.938438] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1136.938657] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1136.938831] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1136.938956] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1136.939124] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.963130] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.963322] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1136.963465] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.963711] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-516" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.964066] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-d0dbc148-4143-426b-821a-6a11b4ab032f taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.964258] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-d0dbc148-4143-426b-821a-6a11b4ab032f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.964749] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-d0dbc148-4143-426b-821a-6a11b4ab032f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.965152] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-d0dbc148-4143-426b-821a-6a11b4ab032f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.965306] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0dbc148-4143-426b-821a-6a11b4ab032f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.019266] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.019266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.019266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.019266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.019722] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.019843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.019908] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.020101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.020187] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.020271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.020427] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.020521] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.020580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.020723] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.020858] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.020984] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.020984] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.021159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.021234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.021443] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.021594] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.111608] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.347203] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.347203] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.347203] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.347203] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.348029] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.348883] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.349476] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.353200] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.353200] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.353200] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1137.353200] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1137.353200] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1137.353200] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1137.353200] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1137.353200] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1137.353200] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1137.373501] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1137.373501] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1137.373501] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1137.374236] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.374236] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-c3c44d5a-dbd9-429a-be5a-a6e04da76c98 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.374236] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-c3c44d5a-dbd9-429a-be5a-a6e04da76c98" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.374396] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-c3c44d5a-dbd9-429a-be5a-a6e04da76c98" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.377527] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-c3c44d5a-dbd9-429a-be5a-a6e04da76c98" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.377527] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3c44d5a-dbd9-429a-be5a-a6e04da76c98',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.467879] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.471182] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.471182] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.471182] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.471182] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.471182] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port d0dbc148-4143-426b-821a-6a11b4ab032f not found, creating... [ 1137.471182] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.471182] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.471182] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.471182] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.471182] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.471514] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.471514] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.472128] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.472556] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.472927] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.473777] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: d0dbc148-4143-426b-821a-6a11b4ab032f is going to be created. [ 1137.497523] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.497742] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.497871] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.498289] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.498539] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.498814] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-d0dbc148-4143-426b-821a-6a11b4ab032f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.524605] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c336180-c6d8-473b-8306-38646bd8e00e: rpc.has_security_group_logging(os_id): False [ 1137.554135] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.554241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.554241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.554501] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.554597] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.555369] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.555485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.555550] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.555827] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.556057] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.556836] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.556836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.556836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.556836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.557093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.557201] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.557356] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.557457] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.557646] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.557733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.557828] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1137.613932] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.693031] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.693031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.693031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.693031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.693031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.704932] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1137.705537] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.714847] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1137.880340] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.882320] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.882320] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.882594] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.882819] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.883056] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port c3c44d5a-dbd9-429a-be5a-a6e04da76c98 not found, creating... [ 1137.883489] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.883811] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.884014] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.888292] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.888292] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.888292] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.888292] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.888292] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.888292] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.888292] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.888521] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: c3c44d5a-dbd9-429a-be5a-a6e04da76c98 is going to be created. [ 1137.920520] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.920714] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.920854] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.921122] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.921436] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.921722] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-c3c44d5a-dbd9-429a-be5a-a6e04da76c98" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.116403] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.116535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.116535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.116734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.116898] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.116940] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1138.156600] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.156975] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.156975] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.157059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.157172] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.169029] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1138.335205] env[69343]: INFO networking_nsxv3.common.synchronization [req-d66cf30d-3a21-4a70-815c-c7228df0fb61 req-583d5883-f4e2-4e5e-9744-cf38a21ba9e2 service nova] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_rules [ 1138.335426] env[69343]: INFO networking_nsxv3.common.synchronization [req-d66cf30d-3a21-4a70-815c-c7228df0fb61 req-583d5883-f4e2-4e5e-9744-cf38a21ba9e2 service nova] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1138.335600] env[69343]: INFO networking_nsxv3.common.synchronization [req-d66cf30d-3a21-4a70-815c-c7228df0fb61 req-583d5883-f4e2-4e5e-9744-cf38a21ba9e2 service nova] Enqueued Resource ID: d0dbc148-4143-426b-821a-6a11b4ab032f with Priority: HIGHEST for action port [ 1138.336733] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_rules [ 1138.336848] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1138.336949] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0dbc148-4143-426b-821a-6a11b4ab032f with Priority: HIGHEST for action port [ 1138.337254] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.337379] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.337446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.337651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.337740] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.339239] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.339343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.339544] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0dbc148-4143-426b-821a-6a11b4ab032f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.339648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0dbc148-4143-426b-821a-6a11b4ab032f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.339745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0dbc148-4143-426b-821a-6a11b4ab032f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.339895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0dbc148-4143-426b-821a-6a11b4ab032f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.339972] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0dbc148-4143-426b-821a-6a11b4ab032f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.794132] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: SUCCESS [ 1138.794132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.851254] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.851254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.851254] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0dbc148-4143-426b-821a-6a11b4ab032f with status ACTIVE [ 1138.851254] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.851254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.851254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.851254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.851254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.851254] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.851254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.851254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.851254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.851254] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.851254] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.852039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.852039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.852039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.852039] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.852039] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0dbc148-4143-426b-821a-6a11b4ab032f is going to be updated. [ 1138.875937] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.876144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.876144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.876420] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.876508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.876726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0dbc148-4143-426b-821a-6a11b4ab032f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.084017] env[69343]: INFO networking_nsxv3.common.synchronization [req-1ec8ac95-66e2-4fe3-b015-830c2926bad6 req-849f9165-de05-4b81-96ad-90a32e9f55d4 service nova] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_rules [ 1139.084226] env[69343]: INFO networking_nsxv3.common.synchronization [req-1ec8ac95-66e2-4fe3-b015-830c2926bad6 req-849f9165-de05-4b81-96ad-90a32e9f55d4 service nova] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1139.084404] env[69343]: INFO networking_nsxv3.common.synchronization [req-1ec8ac95-66e2-4fe3-b015-830c2926bad6 req-849f9165-de05-4b81-96ad-90a32e9f55d4 service nova] Enqueued Resource ID: c3c44d5a-dbd9-429a-be5a-a6e04da76c98 with Priority: HIGHEST for action port [ 1139.084607] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_rules [ 1139.084738] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1139.084823] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3c44d5a-dbd9-429a-be5a-a6e04da76c98 with Priority: HIGHEST for action port [ 1139.085375] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.086850] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.087007] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.087252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.087370] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.088451] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.088451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.088451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.088956] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.090036] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.090539] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.090708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.093641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.093641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.093641] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.093641] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3c44d5a-dbd9-429a-be5a-a6e04da76c98 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.093641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3c44d5a-dbd9-429a-be5a-a6e04da76c98" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.093641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3c44d5a-dbd9-429a-be5a-a6e04da76c98" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.093641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3c44d5a-dbd9-429a-be5a-a6e04da76c98" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.093641] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3c44d5a-dbd9-429a-be5a-a6e04da76c98',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.596175] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.596175] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.596175] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.596175] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3c44d5a-dbd9-429a-be5a-a6e04da76c98 with status ACTIVE [ 1139.596441] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.596441] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.596441] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.596602] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.596685] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.596853] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.597095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.597095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.597192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.597266] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.597444] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.597533] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.597591] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.597725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.597796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.597990] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3c44d5a-dbd9-429a-be5a-a6e04da76c98 is going to be updated. [ 1139.621816] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.621956] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.622042] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.622257] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.622393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.622544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3c44d5a-dbd9-429a-be5a-a6e04da76c98" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.730045] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1139.730387] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.070416] env[69343]: INFO networking_nsxv3.common.synchronization [None req-3a6227fd-ea62-4838-9b10-911910e2c91a None None] Enqueued Resource ID: bc22becc-e90e-434c-844f-475f49fc5a40 with Priority: HIGHEST for action port [ 1140.070775] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc22becc-e90e-434c-844f-475f49fc5a40 with Priority: HIGHEST for action port [ 1140.071792] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc22becc-e90e-434c-844f-475f49fc5a40 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.071942] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc22becc-e90e-434c-844f-475f49fc5a40" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.073336] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc22becc-e90e-434c-844f-475f49fc5a40" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.073638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc22becc-e90e-434c-844f-475f49fc5a40" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.073772] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc22becc-e90e-434c-844f-475f49fc5a40',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.100358] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.179849] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1140.180142] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.180301] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.180517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.180804] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.180950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.181066] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.181262] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.181353] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.181469] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.580194] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc22becc-e90e-434c-844f-475f49fc5a40 [ 1140.580593] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.580806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.581041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.581366] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.581537] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.581708] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc22becc-e90e-434c-844f-475f49fc5a40 already deleted. [ 1140.581825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc22becc-e90e-434c-844f-475f49fc5a40" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.602817] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.602817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.603051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.603162] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.603280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.603415] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be updated. [ 1140.646068] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.646224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.646285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.646482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.646629] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.667320] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: IN_PROGRESS for 2s [ 1140.684068] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.190195] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.693227] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.693227] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.693227] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.693227] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.693227] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.693227] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1141.725054] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.725054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.725054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.725412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.725412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.737248] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1142.392717] env[69343]: INFO networking_nsxv3.common.synchronization [req-b78c488f-dd6b-448b-9389-c71627249ac6 req-60761e66-7eb0-411d-a8ad-e8534bc30977 tempest-ServersNegativeTestJSON-949345807 tempest-ServersNegativeTestJSON-949345807-project-member] Enqueued Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_members [ 1142.393404] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_members [ 1142.393871] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.393976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.394743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.395069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.395303] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.395454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.395530] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.395733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.395796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.395905] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.533140] env[69343]: INFO networking_nsxv3.common.synchronization [None req-4402e8c2-bd27-4245-86d6-82d926857323 None None] Enqueued Resource ID: 01caa08a-f87d-4b7a-9fab-04912b3ff133 with Priority: HIGHEST for action port [ 1142.533768] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01caa08a-f87d-4b7a-9fab-04912b3ff133 with Priority: HIGHEST for action port [ 1142.534240] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-01caa08a-f87d-4b7a-9fab-04912b3ff133 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.534240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01caa08a-f87d-4b7a-9fab-04912b3ff133" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.534492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01caa08a-f87d-4b7a-9fab-04912b3ff133" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.534709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01caa08a-f87d-4b7a-9fab-04912b3ff133" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.534709] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01caa08a-f87d-4b7a-9fab-04912b3ff133',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.680096] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1142.680454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.681100] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.681422] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.681935] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.681935] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.681935] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.682257] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.682257] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.682313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.682395] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.898333] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.037878] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01caa08a-f87d-4b7a-9fab-04912b3ff133 [ 1143.038020] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.038180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.038261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.038514] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.038612] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.038714] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01caa08a-f87d-4b7a-9fab-04912b3ff133 already deleted. [ 1143.038801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01caa08a-f87d-4b7a-9fab-04912b3ff133" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.185707] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.185707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.185707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.186053] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.186053] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.186178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.186178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.186718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.186718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.186718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.186718] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.186718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.186718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.187036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.187036] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.187145] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.187192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.187318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.187388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.187466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.187555] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.401488] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.690048] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e6e2d6-f175-4be9-be9a-bdb1208e0e04: rpc.has_security_group_logging(os_id): False [ 1143.711536] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.711873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.711873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.712160] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.712312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.712557] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.712671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.712781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.712933] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.713013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.713222] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.713308] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.713361] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.713513] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.713580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.713804] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.713919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.713978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.714090] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.714192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.714340] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be updated. [ 1143.748396] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1143.748672] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.748796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.749043] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.749245] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.749369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.749441] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.749605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.749757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.749757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.749849] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.791320] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.791604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.791744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.792031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.792224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.808399] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: IN_PROGRESS for 2s [ 1143.904241] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.904767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.904767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.904767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.904978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.904978] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8943f91-6f84-437f-912a-5f193b3365a6 is going to be updated. [ 1143.953948] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.954149] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.954201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.954382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.954529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.969399] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: IN_PROGRESS for 2s [ 1144.255269] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.255484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.255484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.256659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.256659] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.256659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.256659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.256659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.256659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.256659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.256659] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.257052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.257052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.257052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.257052] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.257167] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.257252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.257319] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.257398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.257499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.257564] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.760136] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ff65ed7-3c36-4248-86bb-8bb20a53fde4: rpc.has_security_group_logging(os_id): False [ 1144.780067] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.780342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.780439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.780766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.780929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.781307] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.781484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.781606] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.781910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.782080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.782348] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.782522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.782633] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.782875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.783023] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.783318] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.783482] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.783601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.783855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.783997] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.784171] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1144.869230] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.869230] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.869422] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.869542] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.869753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.890320] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1145.825974] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1145.826336] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.980210] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: SUCCESS [ 1145.980210] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.910033] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1146.910335] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.534978] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1147.535163] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1147.949117] env[69343]: INFO networking_nsxv3.common.synchronization [req-035b048f-ce5c-40b6-8c73-1988eb26e072 req-264d62c5-c7f8-446b-b1d7-408249b9cb5a tempest-ServerMetadataTestJSON-978332903 tempest-ServerMetadataTestJSON-978332903-project-member] Enqueued Resource ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 with Priority: HIGHEST for action security_group_members [ 1147.949679] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 with Priority: HIGHEST for action security_group_members [ 1147.950179] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-245e50c5-d6d1-43b6-989e-be2a4b49ad04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.950343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.950604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.950788] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.950858] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.950970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.951283] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.952091] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.952231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.952340] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('245e50c5-d6d1-43b6-989e-be2a4b49ad04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.414520] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.414753] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-173" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.415034] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-173" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.415680] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-173" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.416648] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.416851] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.416988] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.417269] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.417427] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.417655] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.417774] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.417893] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.418022] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.418136] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.418245] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.418386] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.440183] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.440398] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1148.440570] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.440764] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-173" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.441146] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-181827e6-32d0-493a-b39c-ede65aa97cdc taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.441354] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-181827e6-32d0-493a-b39c-ede65aa97cdc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.441492] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-181827e6-32d0-493a-b39c-ede65aa97cdc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.441869] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-181827e6-32d0-493a-b39c-ede65aa97cdc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.442041] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('181827e6-32d0-493a-b39c-ede65aa97cdc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.456317] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.456891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.456891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.456891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.456891] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.457070] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.457125] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.457192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.457344] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.457419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.457506] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 already deleted. [ 1148.457586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.944444] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.944712] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.944921] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.945319] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.945415] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.945541] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 181827e6-32d0-493a-b39c-ede65aa97cdc not found, creating... [ 1148.945933] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.946158] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.946291] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.946536] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.946679] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.947113] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.947338] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.947506] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.947743] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.947881] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.948038] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 181827e6-32d0-493a-b39c-ede65aa97cdc is going to be created. [ 1148.972114] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.972606] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.972606] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.972840] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.973106] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.973348] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-181827e6-32d0-493a-b39c-ede65aa97cdc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.758501] env[69343]: INFO networking_nsxv3.common.synchronization [req-035b048f-ce5c-40b6-8c73-1988eb26e072 req-ae790250-2789-4c33-9655-a2328ab2d25c service nova] Enqueued Resource ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 with Priority: HIGHEST for action security_group_rules [ 1149.758501] env[69343]: INFO networking_nsxv3.common.synchronization [req-035b048f-ce5c-40b6-8c73-1988eb26e072 req-ae790250-2789-4c33-9655-a2328ab2d25c service nova] Enqueued Resource ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 with Priority: HIGHEST for action security_group_members [ 1149.758501] env[69343]: INFO networking_nsxv3.common.synchronization [req-035b048f-ce5c-40b6-8c73-1988eb26e072 req-ae790250-2789-4c33-9655-a2328ab2d25c service nova] Enqueued Resource ID: 181827e6-32d0-493a-b39c-ede65aa97cdc with Priority: HIGHEST for action port [ 1149.759647] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 with Priority: HIGHEST for action security_group_rules [ 1149.760179] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 with Priority: HIGHEST for action security_group_members [ 1149.760497] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 181827e6-32d0-493a-b39c-ede65aa97cdc with Priority: HIGHEST for action port [ 1149.761054] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-245e50c5-d6d1-43b6-989e-be2a4b49ad04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.761434] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.764103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.764103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.764103] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('245e50c5-d6d1-43b6-989e-be2a4b49ad04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.764103] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-245e50c5-d6d1-43b6-989e-be2a4b49ad04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.764103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.764103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.764718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.765042] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.765382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.770008] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.770008] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.770008] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.770008] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('245e50c5-d6d1-43b6-989e-be2a4b49ad04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.770008] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-181827e6-32d0-493a-b39c-ede65aa97cdc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.770008] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-181827e6-32d0-493a-b39c-ede65aa97cdc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.770008] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-181827e6-32d0-493a-b39c-ede65aa97cdc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.770008] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-181827e6-32d0-493a-b39c-ede65aa97cdc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.770008] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('181827e6-32d0-493a-b39c-ede65aa97cdc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.271072] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('245e50c5-d6d1-43b6-989e-be2a4b49ad04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.271630] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-245e50c5-d6d1-43b6-989e-be2a4b49ad04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.271755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.271933] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 181827e6-32d0-493a-b39c-ede65aa97cdc with status ACTIVE [ 1150.272129] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.272281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.272366] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.272596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.272703] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.272881] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.272980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.273103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.273201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.273293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.273463] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.273556] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.273616] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.273753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.273887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.273990] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 181827e6-32d0-493a-b39c-ede65aa97cdc is going to be updated. [ 1150.297964] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.297964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.297964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.298367] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.298367] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.298537] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-181827e6-32d0-493a-b39c-ede65aa97cdc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.776479] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('245e50c5-d6d1-43b6-989e-be2a4b49ad04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.279601] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.280049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.280049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.280330] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.280469] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.280596] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 is going to be created. [ 1151.326712] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.326975] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.326975] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.327209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.327459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.343081] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 in Status: UNINITIALIZED for 2s [ 1152.044455] env[69343]: INFO networking_nsxv3.common.synchronization [req-7c079fd7-a3d1-4f29-b450-ba9db78cb0ef req-da7a50ca-8391-4bba-9a55-e177a612905c tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1152.045024] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1152.046195] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.046195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.046195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.046195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.046195] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.046457] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.046457] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.046602] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.046653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.047748] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.549626] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.780205] env[69343]: INFO networking_nsxv3.common.synchronization [req-c279698c-f859-402a-ad22-1d33c023e458 req-14561c39-87e2-4ad0-8161-e2548ae86dbc tempest-ServersTestJSON-245111932 tempest-ServersTestJSON-245111932-project-member] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1152.780205] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1152.780205] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.780205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.780205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.780205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.780205] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.780205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.780602] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.780848] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.781044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.781231] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.862451] env[69343]: INFO networking_nsxv3.common.synchronization [None req-65d346eb-d72a-4e7c-99dd-61732c150471 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1152.862937] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1152.863271] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.863435] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.051829] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.284402] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.355736] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 in Status: SUCCESS [ 1153.355959] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.356213] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.356454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.356653] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.356771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.356838] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.356975] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.357070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.357210] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.357314] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('245e50c5-d6d1-43b6-989e-be2a4b49ad04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.556376] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.556376] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.556376] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.556376] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.556376] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.556376] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be updated. [ 1153.602880] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.603101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.603101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.603307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.603473] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.614485] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: IN_PROGRESS for 2s [ 1153.786505] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.859557] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-245e50c5-d6d1-43b6-989e-be2a4b49ad04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.859732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.862924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.862924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.862924] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.862924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.862924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.862924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.862924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.862924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.862924] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-245e50c5-d6d1-43b6-989e-be2a4b49ad04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.862924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.862924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.862924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.862924] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.862924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.862924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.862924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.862924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.862924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.863698] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('245e50c5-d6d1-43b6-989e-be2a4b49ad04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.289186] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.289443] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.289443] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.289650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.289744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.289851] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1154.325040] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.325290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.325290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.325978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.325978] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.337228] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1154.366064] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 245e50c5-d6d1-43b6-989e-be2a4b49ad04: rpc.has_security_group_logging(os_id): False [ 1154.386329] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.386654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.386654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.386822] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.386931] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.387171] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.387302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.387362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.387602] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.387739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.388011] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.388152] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.388252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.388394] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.388444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.388634] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.388721] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.388826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.388996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.388996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.389089] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 is going to be created. [ 1154.460401] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.460401] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.460401] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.460401] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.460401] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.474861] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 in Status: IN_PROGRESS for 2s [ 1155.624770] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1155.625277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.625277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.625542] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.625785] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.625946] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.626052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.626231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.626348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.626466] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.129288] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.129288] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.129539] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.129539] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.129664] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.129968] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.130170] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.130280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.130539] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.130670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.130815] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be updated. [ 1156.164262] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.164474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.164522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.164713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.164857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.174501] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: IN_PROGRESS for 2s [ 1156.348900] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1156.349199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.488322] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 in Status: SUCCESS [ 1156.488624] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.853123] env[69343]: INFO networking_nsxv3.common.synchronization [req-6bb38581-ddfb-4907-ab96-5d60383f3809 req-35361261-9109-4478-86de-134ea9b9935f tempest-DeleteServersTestJSON-1417757124 tempest-DeleteServersTestJSON-1417757124-project-member] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1157.854052] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1157.854220] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.854352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.854415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.854619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.854784] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.854917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.854973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.855145] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.855237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.855398] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.183933] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1158.184169] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 deletion is rescheduled due to dependency. [ 1158.184294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.359079] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.359264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.359323] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.359593] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.359645] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.359837] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.359969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.360045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.360153] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.360233] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.360327] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1158.410016] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.410198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.410264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.410445] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.410587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.421294] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1159.752340] env[69343]: INFO networking_nsxv3.common.synchronization [req-e74205a0-70f4-4361-ab56-ea03e853a912 req-7653324f-4ac1-43b5-9ebb-f558788f4aae tempest-ServersTestJSON-245111932 tempest-ServersTestJSON-245111932-project-member] Enqueued Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1159.752952] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 with Priority: HIGHEST for action security_group_members [ 1159.756140] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.756272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.756348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.756535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.756712] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.756802] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.756921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.757017] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.757104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.757202] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ff65ed7-3c36-4248-86bb-8bb20a53fde4',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.260035] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.260228] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.260300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.260521] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.260614] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.260819] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.260954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.260997] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.261144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.261224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.261311] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 is going to be updated. [ 1160.294565] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.294763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.294763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.294984] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.295170] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.304570] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: IN_PROGRESS for 2s [ 1160.432841] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1160.433363] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e deletion is rescheduled due to dependency. [ 1160.433363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.315671] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 in Status: SUCCESS [ 1162.316029] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ff65ed7-3c36-4248-86bb-8bb20a53fde4 deletion is rescheduled due to dependency. [ 1162.316078] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ff65ed7-3c36-4248-86bb-8bb20a53fde4" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.493350] env[69343]: INFO networking_nsxv3.common.synchronization [req-4be00ca7-8c95-4bf5-826e-d195101b08ef req-292e39de-5409-4e72-979d-0b71d045ff23 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: d8742911-68ce-4e04-af8f-97f736173e2f with Priority: HIGHEST for action security_group_members [ 1162.493903] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8742911-68ce-4e04-af8f-97f736173e2f with Priority: HIGHEST for action security_group_members [ 1162.494271] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8742911-68ce-4e04-af8f-97f736173e2f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.494419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.494725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.494725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.496495] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.496495] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.496606] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.496702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.496818] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.496920] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8742911-68ce-4e04-af8f-97f736173e2f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.926031] env[69343]: INFO networking_nsxv3.common.synchronization [req-8de534c4-a37b-4527-8b4e-b98b1bab79c4 req-e78ade66-d695-440d-9231-09667befc10b tempest-ServerMetadataTestJSON-978332903 tempest-ServerMetadataTestJSON-978332903-project-member] Enqueued Resource ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 with Priority: HIGHEST for action security_group_members [ 1162.926031] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 with Priority: HIGHEST for action security_group_members [ 1162.926031] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-245e50c5-d6d1-43b6-989e-be2a4b49ad04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.926031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.926031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.926031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.926672] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.926908] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.927092] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.927590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.927844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.928055] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('245e50c5-d6d1-43b6-989e-be2a4b49ad04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.002565] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.002565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.002565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.002830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.022393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.022519] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.022642] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.022714] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.022918] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.023012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.023112] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8742911-68ce-4e04-af8f-97f736173e2f is going to be updated. [ 1163.051814] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.051814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.051814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.051814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.051814] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.060612] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8742911-68ce-4e04-af8f-97f736173e2f in Status: IN_PROGRESS for 2s [ 1163.432704] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.433029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.433029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.433232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.433314] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.433484] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.433577] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.433636] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.433783] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.433859] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.433978] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 is going to be updated. [ 1163.475224] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.475224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.475224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.475224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.475224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.485713] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 in Status: IN_PROGRESS for 2s [ 1165.070901] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8742911-68ce-4e04-af8f-97f736173e2f in Status: SUCCESS [ 1165.071183] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8742911-68ce-4e04-af8f-97f736173e2f deletion is rescheduled due to dependency. [ 1165.071231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8742911-68ce-4e04-af8f-97f736173e2f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.497484] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 in Status: SUCCESS [ 1165.497738] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 deletion is rescheduled due to dependency. [ 1165.497904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.926214] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1167.926574] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1172.242637] env[69343]: INFO networking_nsxv3.common.synchronization [None req-2c7a611d-f745-4740-beda-872ec0712db1 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_rules [ 1172.243355] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_rules [ 1172.243687] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.243811] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.243873] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.244209] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.244321] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.314329] env[69343]: INFO networking_nsxv3.common.synchronization [None req-da44506e-4677-4aba-9de2-aed081026139 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_rules [ 1172.314329] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_rules [ 1172.314329] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.314329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.766708] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.767012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.767165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.767524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.767675] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.767831] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 already deleted. [ 1172.767968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.768212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.768466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.768600] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.291697] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.292819] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.292819] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.292819] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.292819] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.292819] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 already deleted. [ 1173.292819] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.314648] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1177.314648] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1177.350412] env[69343]: INFO networking_nsxv3.common.synchronization [None req-1d5bfd1f-828f-48ac-aafa-44d411f39a4d None None] Enqueued Resource ID: c795410e-4826-4343-997d-12da06eb7bc7 with Priority: HIGHEST for action port [ 1177.351036] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c795410e-4826-4343-997d-12da06eb7bc7 with Priority: HIGHEST for action port [ 1177.351372] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-c795410e-4826-4343-997d-12da06eb7bc7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.351523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c795410e-4826-4343-997d-12da06eb7bc7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.351608] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c795410e-4826-4343-997d-12da06eb7bc7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.352228] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c795410e-4826-4343-997d-12da06eb7bc7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.352335] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c795410e-4826-4343-997d-12da06eb7bc7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.798402] env[69343]: INFO networking_nsxv3.common.synchronization [req-5422c956-7c66-4f5b-b661-f2f8faeb2285 req-a50bafad-bc59-4f77-9266-246b5aa7efde tempest-DeleteServersTestJSON-1417757124 tempest-DeleteServersTestJSON-1417757124-project-member] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1177.799027] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1177.799459] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.799459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.799569] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.799720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.799873] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.799970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.800077] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.800195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.800277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.800510] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.854526] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c795410e-4826-4343-997d-12da06eb7bc7 [ 1177.854785] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.854911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.854989] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.855370] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.855528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.855718] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c795410e-4826-4343-997d-12da06eb7bc7 already deleted. [ 1177.857648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c795410e-4826-4343-997d-12da06eb7bc7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.154881] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-284 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.156137] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.156137] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.156137] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.156345] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.156345] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.156509] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.156776] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.157373] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.157373] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1178.157373] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1178.157373] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1178.157521] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1178.157664] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1178.157705] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1178.157918] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1178.184610] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1178.185154] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1178.185396] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1178.185584] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.185947] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-c8c4e707-b315-4c00-a295-b5c511c37aa3 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.186178] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-c8c4e707-b315-4c00-a295-b5c511c37aa3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.186323] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-c8c4e707-b315-4c00-a295-b5c511c37aa3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.186869] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-c8c4e707-b315-4c00-a295-b5c511c37aa3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.187070] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8c4e707-b315-4c00-a295-b5c511c37aa3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.304092] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.304594] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.304594] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.304894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.305040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.305278] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.305393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.305458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.306238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.307188] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.307188] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1178.336112] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.336500] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.336500] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.336769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.336769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.347420] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1178.690424] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.691091] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.691091] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.691366] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.691864] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.691864] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port c8c4e707-b315-4c00-a295-b5c511c37aa3 not found, creating... [ 1178.692033] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.692269] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.692452] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.692741] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.693233] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.693665] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.693866] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.694011] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.694349] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.694564] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.694994] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: c8c4e707-b315-4c00-a295-b5c511c37aa3 is going to be created. [ 1178.718022] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.718022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.718022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.718022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.718022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.718022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-c8c4e707-b315-4c00-a295-b5c511c37aa3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.436073] env[69343]: INFO networking_nsxv3.common.synchronization [req-5422c956-7c66-4f5b-b661-f2f8faeb2285 req-1919ba17-333c-44c2-b51a-c838df3a7cfa service nova] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_rules [ 1179.436073] env[69343]: INFO networking_nsxv3.common.synchronization [req-5422c956-7c66-4f5b-b661-f2f8faeb2285 req-1919ba17-333c-44c2-b51a-c838df3a7cfa service nova] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1179.436073] env[69343]: INFO networking_nsxv3.common.synchronization [req-5422c956-7c66-4f5b-b661-f2f8faeb2285 req-1919ba17-333c-44c2-b51a-c838df3a7cfa service nova] Enqueued Resource ID: c8c4e707-b315-4c00-a295-b5c511c37aa3 with Priority: HIGHEST for action port [ 1179.436073] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_rules [ 1179.436073] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1179.437024] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8c4e707-b315-4c00-a295-b5c511c37aa3 with Priority: HIGHEST for action port [ 1179.437621] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.442680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.442680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.442680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.442680] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.442680] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.443154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.443563] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8c4e707-b315-4c00-a295-b5c511c37aa3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.443888] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8c4e707-b315-4c00-a295-b5c511c37aa3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.444108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8c4e707-b315-4c00-a295-b5c511c37aa3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.444505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8c4e707-b315-4c00-a295-b5c511c37aa3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.444797] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8c4e707-b315-4c00-a295-b5c511c37aa3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.628251] env[69343]: INFO networking_nsxv3.common.synchronization [None req-9e3479b8-8807-439c-8b40-fa6d3c391c6d None None] Enqueued Resource ID: 7b5a8752-75fb-48c6-95b3-920f6893d581 with Priority: HIGHEST for action port [ 1179.628874] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b5a8752-75fb-48c6-95b3-920f6893d581 with Priority: HIGHEST for action port [ 1179.629245] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b5a8752-75fb-48c6-95b3-920f6893d581 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.629600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b5a8752-75fb-48c6-95b3-920f6893d581" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.629600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b5a8752-75fb-48c6-95b3-920f6893d581" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.629804] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b5a8752-75fb-48c6-95b3-920f6893d581" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.629883] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b5a8752-75fb-48c6-95b3-920f6893d581',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.948393] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.948549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.948767] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8c4e707-b315-4c00-a295-b5c511c37aa3 with status ACTIVE [ 1179.948984] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.949121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.949198] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.949414] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.949525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.949710] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.949821] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.949882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.950089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.950180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.950388] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.950487] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.950733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.950733] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.950833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.950882] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8c4e707-b315-4c00-a295-b5c511c37aa3 is going to be updated. [ 1179.976027] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.976027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.976027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.976269] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.976269] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.976378] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8c4e707-b315-4c00-a295-b5c511c37aa3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.132471] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b5a8752-75fb-48c6-95b3-920f6893d581 [ 1180.132790] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.132965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.133094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.133341] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.133447] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.134199] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b5a8752-75fb-48c6-95b3-920f6893d581 already deleted. [ 1180.134199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b5a8752-75fb-48c6-95b3-920f6893d581" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.359186] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1180.359368] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e deletion is rescheduled due to dependency. [ 1180.359490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.359930] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.360177] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.360369] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.360486] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.360548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.360694] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.360777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.360876] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.863537] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.366372] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.889095] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.889095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.889095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.889095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.889095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.889095] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1181.919289] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.919528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.919528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.919747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.919927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.928888] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1183.941405] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1183.941662] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.941897] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.942234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.942541] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.942766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.942823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.943100] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.943244] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.943412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.943581] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.446681] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.446882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.447029] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.447564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.447788] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.447906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.447975] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.448193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.448291] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.448384] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.448548] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.448645] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.448708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.448862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.449008] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.449123] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.449207] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.449358] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.449440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.449526] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.449615] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.630382] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1184.630487] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1184.953239] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c336180-c6d8-473b-8306-38646bd8e00e: rpc.has_security_group_logging(os_id): False [ 1184.975373] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.975373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.975373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.975373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.975373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.975373] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.975373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.975373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.975373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.975710] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.975710] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.975710] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.975805] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.976529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.976529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.976529] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.976529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.976529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.976529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.976529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.977073] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1185.041193] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.041468] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.041468] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.041762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.041969] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.062304] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1185.172838] env[69343]: INFO networking_nsxv3.common.synchronization [req-b642bcfb-5739-45fe-821a-81c6d0f41da5 req-2e4ccc50-680d-4531-9322-002adc729428 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_members [ 1185.176836] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_members [ 1185.176836] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.176836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.176836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.176836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.176836] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.176836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.176836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.176836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.176836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.176836] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.517163] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.517428] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.517591] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.517873] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.518188] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.518408] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.518557] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.518825] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.518976] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.519239] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1185.519383] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1185.519506] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1185.519620] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1185.519737] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1185.519846] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1185.519982] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1185.538922] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1185.539129] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1185.539313] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1185.539651] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.540060] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-2fe99613-863a-42da-a8f0-edae7923067a taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.540256] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-2fe99613-863a-42da-a8f0-edae7923067a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.540409] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-2fe99613-863a-42da-a8f0-edae7923067a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.540790] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-2fe99613-863a-42da-a8f0-edae7923067a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.540968] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fe99613-863a-42da-a8f0-edae7923067a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.678761] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.678923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.678986] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.679226] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.679319] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.679520] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.679653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.679724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.679878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.679957] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.680057] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 already deleted. [ 1185.680418] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.043765] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.044300] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.044300] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.044551] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.044807] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.045066] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 2fe99613-863a-42da-a8f0-edae7923067a not found, creating... [ 1186.045358] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.045538] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.045666] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.046026] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.046407] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.046717] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.046883] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.047014] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.047249] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.047397] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.047548] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 2fe99613-863a-42da-a8f0-edae7923067a is going to be created. [ 1186.073619] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.073844] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.074015] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.074366] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.074734] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.075062] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-2fe99613-863a-42da-a8f0-edae7923067a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.771096] env[69343]: INFO networking_nsxv3.common.synchronization [req-b642bcfb-5739-45fe-821a-81c6d0f41da5 req-3f5757c3-887e-41c8-9b70-0588b3fe272c service nova] Enqueued Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_rules [ 1186.771096] env[69343]: INFO networking_nsxv3.common.synchronization [req-b642bcfb-5739-45fe-821a-81c6d0f41da5 req-3f5757c3-887e-41c8-9b70-0588b3fe272c service nova] Enqueued Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_members [ 1186.771096] env[69343]: INFO networking_nsxv3.common.synchronization [req-b642bcfb-5739-45fe-821a-81c6d0f41da5 req-3f5757c3-887e-41c8-9b70-0588b3fe272c service nova] Enqueued Resource ID: 2fe99613-863a-42da-a8f0-edae7923067a with Priority: HIGHEST for action port [ 1186.771096] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_rules [ 1186.771096] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_members [ 1186.771096] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe99613-863a-42da-a8f0-edae7923067a with Priority: HIGHEST for action port [ 1186.773524] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.773524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.773524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.773524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.773689] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.774870] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.774996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.775083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.775261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.775420] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.775522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.775588] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.775730] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.775816] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.775909] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.776731] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fe99613-863a-42da-a8f0-edae7923067a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.776882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fe99613-863a-42da-a8f0-edae7923067a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.776913] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fe99613-863a-42da-a8f0-edae7923067a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.777068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fe99613-863a-42da-a8f0-edae7923067a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.777146] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fe99613-863a-42da-a8f0-edae7923067a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.079310] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1187.079712] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.279182] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.279342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.279531] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.280579] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2fe99613-863a-42da-a8f0-edae7923067a with status ACTIVE [ 1187.280892] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.280892] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.280892] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.281038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.281202] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.281276] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.281348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.281570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.281570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.281702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.282066] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.282224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.282296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.282499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.282499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.282586] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2fe99613-863a-42da-a8f0-edae7923067a is going to be updated. [ 1187.305148] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.305148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.305148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.305517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.305555] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.305703] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fe99613-863a-42da-a8f0-edae7923067a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.784642] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.287271] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.287648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.287694] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.287936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.288076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.288202] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 is going to be created. [ 1188.316880] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.317110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.317163] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.317374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.317567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.327322] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 in Status: UNINITIALIZED for 2s [ 1189.058587] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.058795] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-656" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.058929] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-656" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.059240] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-656" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.059586] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.059798] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.059932] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.060364] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.060531] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.060750] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.060870] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1189.060984] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1189.061115] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1189.061237] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1189.061387] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1189.061530] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1189.081645] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1189.081814] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1189.081958] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1189.082155] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-656" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.082483] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.082659] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.082780] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.083099] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.083266] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cb84584-8dfb-4d6a-b489-e34fb17fdff9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.585610] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.585924] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.586236] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.586611] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.586785] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.587147] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.587330] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.587463] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.587698] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.587847] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.588143] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.588298] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.588419] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.588632] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.588772] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.588915] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 0cb84584-8dfb-4d6a-b489-e34fb17fdff9 is going to be updated. [ 1189.616136] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.616136] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.616391] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.616431] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.616893] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.617174] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.338254] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 in Status: SUCCESS [ 1190.338481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.338670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.339096] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.339387] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.339516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.339587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.339752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.339840] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.340012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.340115] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.674830] env[69343]: INFO networking_nsxv3.common.synchronization [req-e47f9251-316c-43cd-a14e-76995819e9a1 req-6088d820-efed-4149-b5f8-a165267de3bc tempest-AttachVolumeNegativeTest-1961671669 tempest-AttachVolumeNegativeTest-1961671669-project-member] Enqueued Resource ID: 052516cb-7b57-4fc8-95bb-1de193b1315b with Priority: HIGHEST for action security_group_members [ 1190.674830] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 052516cb-7b57-4fc8-95bb-1de193b1315b with Priority: HIGHEST for action security_group_members [ 1190.675923] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-052516cb-7b57-4fc8-95bb-1de193b1315b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.675923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.675923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.676416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.676416] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.676416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.677112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.677112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.677112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.677112] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('052516cb-7b57-4fc8-95bb-1de193b1315b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.842981] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.890680] env[69343]: INFO networking_nsxv3.common.synchronization [req-a95794bc-30bf-4ecb-af62-0e326ffb83d6 req-77862613-2d47-4a85-9475-3e30c6421842 service nova] Enqueued Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGHEST for action security_group_rules [ 1190.890929] env[69343]: INFO networking_nsxv3.common.synchronization [req-a95794bc-30bf-4ecb-af62-0e326ffb83d6 req-77862613-2d47-4a85-9475-3e30c6421842 service nova] Enqueued Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGHEST for action security_group_members [ 1190.891145] env[69343]: INFO networking_nsxv3.common.synchronization [req-a95794bc-30bf-4ecb-af62-0e326ffb83d6 req-77862613-2d47-4a85-9475-3e30c6421842 service nova] Enqueued Resource ID: 0cb84584-8dfb-4d6a-b489-e34fb17fdff9 with Priority: HIGHEST for action port [ 1190.891728] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGHEST for action security_group_rules [ 1190.891879] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGHEST for action security_group_members [ 1190.892018] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb84584-8dfb-4d6a-b489-e34fb17fdff9 with Priority: HIGHEST for action port [ 1190.893431] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bec412e-0e1e-4a5b-8816-552633942519 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.893547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.893611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.893813] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.893899] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.896179] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bec412e-0e1e-4a5b-8816-552633942519 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.896307] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.896437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.896627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.898077] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.899532] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.899646] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.899847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.899945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.900072] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.901982] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.902142] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.902388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.902624] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.902730] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cb84584-8dfb-4d6a-b489-e34fb17fdff9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.180432] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.180834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.180834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.181136] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.181350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.181593] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.181754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.181858] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.182683] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.182825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.182978] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 052516cb-7b57-4fc8-95bb-1de193b1315b is going to be updated. [ 1191.221446] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.221644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.221644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.221843] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.222030] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.233077] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 052516cb-7b57-4fc8-95bb-1de193b1315b in Status: IN_PROGRESS for 2s [ 1191.346323] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293: rpc.has_security_group_logging(os_id): False [ 1191.364263] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.364471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.364561] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.364777] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.364871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.365133] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.365247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.365541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.365541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.365677] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.365677] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 is going to be created. [ 1191.398230] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bec412e-0e1e-4a5b-8816-552633942519 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.398230] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.402714] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.406409] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0cb84584-8dfb-4d6a-b489-e34fb17fdff9 with status ACTIVE [ 1191.406638] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.406776] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.406846] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.407074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.407175] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.407365] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.408067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.408067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.408067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.408067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.408067] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.408067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.408067] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.408377] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.408377] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.408377] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0cb84584-8dfb-4d6a-b489-e34fb17fdff9 is going to be updated. [ 1191.439119] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.439346] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.439346] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.439628] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.439724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.460022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.460022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.460022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.460022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.460022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.461405] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cb84584-8dfb-4d6a-b489-e34fb17fdff9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.461405] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 in Status: IN_PROGRESS for 2s [ 1191.905815] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.296553] env[69343]: INFO networking_nsxv3.common.synchronization [req-b286769e-2ae9-4f99-8889-0f7d9fce3306 req-35b883f8-df01-4589-bcc8-0abb8f8e7187 tempest-ServerRescueTestJSON-142228568 tempest-ServerRescueTestJSON-142228568-project-member] Enqueued Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGHEST for action security_group_members [ 1192.297262] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGHEST for action security_group_members [ 1192.297598] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe57526-4a38-4213-b086-d05377278315 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.298116] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.298188] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.298461] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.298640] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.299521] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.299628] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.299831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.300231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.300231] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.407956] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.408336] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.408336] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.408709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.408813] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.408940] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bec412e-0e1e-4a5b-8816-552633942519 is going to be updated. [ 1192.445545] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.445545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.445545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.445545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.445545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.459817] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bec412e-0e1e-4a5b-8816-552633942519 in Status: IN_PROGRESS for 2s [ 1192.802887] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.803106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.803106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.803347] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.803437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.803640] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.803740] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.803796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.803949] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.804037] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.804126] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fe57526-4a38-4213-b086-d05377278315 already deleted. [ 1192.804219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.242564] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 052516cb-7b57-4fc8-95bb-1de193b1315b in Status: SUCCESS [ 1193.243137] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 052516cb-7b57-4fc8-95bb-1de193b1315b deletion is rescheduled due to dependency. [ 1193.243137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.474849] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 in Status: SUCCESS [ 1193.475230] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.097304] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-911 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.097304] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-911" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.097304] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-911" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.097304] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-911" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.097777] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.097777] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.097988] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.098406] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.098579] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.098795] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1194.098911] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1194.099040] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1194.099154] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1194.099268] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1194.099377] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1194.099657] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1194.125020] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1194.125020] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1194.125020] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1194.125020] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-911" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.125020] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-9cbb3a61-8b95-4fb2-9b34-58b2e247cca8 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.125020] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-9cbb3a61-8b95-4fb2-9b34-58b2e247cca8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.125020] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-9cbb3a61-8b95-4fb2-9b34-58b2e247cca8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.125020] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-9cbb3a61-8b95-4fb2-9b34-58b2e247cca8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.125020] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cbb3a61-8b95-4fb2-9b34-58b2e247cca8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.126273] env[69343]: INFO networking_nsxv3.common.synchronization [req-6f50b190-3468-45ed-a0b0-9c1d9839c384 req-992b78a8-3a19-42fb-a7ac-bd6ccf71323a tempest-ServerActionsTestOtherA-678333832 tempest-ServerActionsTestOtherA-678333832-project-member] Enqueued Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_members [ 1194.126678] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_members [ 1194.127582] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.128193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.128193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.128311] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.128465] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.128738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.128738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.129312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.129447] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.129693] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.471435] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bec412e-0e1e-4a5b-8816-552633942519 in Status: SUCCESS [ 1194.471797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.471797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.472321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.472321] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.472557] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.472557] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.472617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.473508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.473508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.473508] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.632429] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.632429] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.632429] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.632429] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.632429] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.632429] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 9cbb3a61-8b95-4fb2-9b34-58b2e247cca8 not found, creating... [ 1194.632429] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.632429] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.632429] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.632429] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.632429] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.632891] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.632891] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.632891] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.632891] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.632891] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.632891] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 9cbb3a61-8b95-4fb2-9b34-58b2e247cca8 is going to be created. [ 1194.634682] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.663438] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.663685] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.663814] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.664952] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.664952] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.664952] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-9cbb3a61-8b95-4fb2-9b34-58b2e247cca8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.976322] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.144095] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.479468] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bec412e-0e1e-4a5b-8816-552633942519: rpc.has_security_group_logging(os_id): False [ 1195.502648] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.502835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.502901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.503117] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.503223] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.503588] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.503724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.503790] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.504147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.504147] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.504321] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bec412e-0e1e-4a5b-8816-552633942519 is going to be updated. [ 1195.549664] env[69343]: INFO networking_nsxv3.common.synchronization [req-b286769e-2ae9-4f99-8889-0f7d9fce3306 req-b945ddd0-b982-42be-a5c3-f1ca43d658da service nova] Enqueued Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGHEST for action security_group_rules [ 1195.549842] env[69343]: INFO networking_nsxv3.common.synchronization [req-b286769e-2ae9-4f99-8889-0f7d9fce3306 req-b945ddd0-b982-42be-a5c3-f1ca43d658da service nova] Enqueued Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGHEST for action security_group_members [ 1195.549982] env[69343]: INFO networking_nsxv3.common.synchronization [req-b286769e-2ae9-4f99-8889-0f7d9fce3306 req-b945ddd0-b982-42be-a5c3-f1ca43d658da service nova] Enqueued Resource ID: 9cbb3a61-8b95-4fb2-9b34-58b2e247cca8 with Priority: HIGHEST for action port [ 1195.550240] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGHEST for action security_group_rules [ 1195.550360] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGHEST for action security_group_members [ 1195.550489] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbb3a61-8b95-4fb2-9b34-58b2e247cca8 with Priority: HIGHEST for action port [ 1195.551888] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fe57526-4a38-4213-b086-d05377278315 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.551993] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.552056] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.552359] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.552460] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.553974] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe57526-4a38-4213-b086-d05377278315 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.554108] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.554182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.554386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.554568] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.554684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.554765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.554919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.555090] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.555141] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.557045] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cbb3a61-8b95-4fb2-9b34-58b2e247cca8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.557045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cbb3a61-8b95-4fb2-9b34-58b2e247cca8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.557045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cbb3a61-8b95-4fb2-9b34-58b2e247cca8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.557045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cbb3a61-8b95-4fb2-9b34-58b2e247cca8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.557045] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cbb3a61-8b95-4fb2-9b34-58b2e247cca8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.566511] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.566511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.566511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.566828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.567020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.589621] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bec412e-0e1e-4a5b-8816-552633942519 in Status: IN_PROGRESS for 2s [ 1195.650728] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.651076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.651076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.651292] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.651404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.651531] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc is going to be updated. [ 1195.681269] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.681503] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.681503] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.681681] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.681828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.695752] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: IN_PROGRESS for 2s [ 1196.060497] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe57526-4a38-4213-b086-d05377278315 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.060497] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.060497] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.060712] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cbb3a61-8b95-4fb2-9b34-58b2e247cca8 with status ACTIVE [ 1196.061095] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.061095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.061274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.061449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.061546] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.061814] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.061927] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.062211] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.062484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.062594] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.062953] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.063060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.063202] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.063466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.063649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.063785] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cbb3a61-8b95-4fb2-9b34-58b2e247cca8 is going to be updated. [ 1196.087540] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.087802] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.087926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.088229] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.088441] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.088675] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cbb3a61-8b95-4fb2-9b34-58b2e247cca8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.567391] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.068283] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.068511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.068612] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.068922] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.069070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.069291] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fe57526-4a38-4213-b086-d05377278315 is going to be created. [ 1197.095633] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.095788] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.095856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.096110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.096275] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.108170] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fe57526-4a38-4213-b086-d05377278315 in Status: UNINITIALIZED for 2s [ 1197.609018] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bec412e-0e1e-4a5b-8816-552633942519 in Status: SUCCESS [ 1197.609018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.707904] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: SUCCESS [ 1197.707904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.118225] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fe57526-4a38-4213-b086-d05377278315 in Status: SUCCESS [ 1199.118225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.118620] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.118620] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.118788] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.118906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.118999] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.119144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.119228] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.119327] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.120035] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.625135] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe57526-4a38-4213-b086-d05377278315 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.625135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.625135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.625135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.625135] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.625135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.625135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.625135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.625135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.625135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.625135] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe57526-4a38-4213-b086-d05377278315 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.625135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.625135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.625135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.625135] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.625135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.625945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.625945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.625945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.625945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.625945] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.130198] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fe57526-4a38-4213-b086-d05377278315: rpc.has_security_group_logging(os_id): False [ 1200.153669] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.153904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.153958] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.154186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.154324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.154619] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.154734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.154801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.154980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.155134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.155347] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.155542] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.155623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.155785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.155866] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.156150] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.156251] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.156327] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.156474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.156550] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.156640] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fe57526-4a38-4213-b086-d05377278315 is going to be created. [ 1200.234433] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.234686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.234686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.234908] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.235115] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.246342] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fe57526-4a38-4213-b086-d05377278315 in Status: IN_PROGRESS for 2s [ 1200.552238] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1200.552440] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1202.267673] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fe57526-4a38-4213-b086-d05377278315 in Status: SUCCESS [ 1202.268170] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.796037] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-109 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.796331] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-109" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.796370] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-109" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.796674] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-109" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.796967] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.797157] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.797284] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.797549] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.797731] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.797961] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1204.798173] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1204.798234] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1204.798360] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1204.798497] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1204.798620] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1204.798764] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1204.819513] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1204.819716] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1204.819864] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1204.820102] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-109" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.820491] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-fbb948d3-6d63-4b97-945d-768dfb6ff64b taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.820691] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-fbb948d3-6d63-4b97-945d-768dfb6ff64b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.820826] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-fbb948d3-6d63-4b97-945d-768dfb6ff64b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.821149] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-fbb948d3-6d63-4b97-945d-768dfb6ff64b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.821317] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbb948d3-6d63-4b97-945d-768dfb6ff64b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.324176] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.324445] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.324704] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.324883] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.325063] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.325372] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.325537] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.325663] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.325890] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.326044] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.326331] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.326489] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.326624] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.326818] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.326958] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.327119] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: fbb948d3-6d63-4b97-945d-768dfb6ff64b is going to be updated. [ 1205.353431] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.353896] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.353896] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.354270] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.354411] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.354709] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-fbb948d3-6d63-4b97-945d-768dfb6ff64b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.553289] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1205.553411] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1206.119268] env[69343]: INFO networking_nsxv3.common.synchronization [req-0e2d4e1e-2db6-44a7-bd9c-e1387f7b7de7 req-25cbc9b4-278a-4ef4-b85b-4368ef89c0a4 service nova] Enqueued Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_rules [ 1206.119625] env[69343]: INFO networking_nsxv3.common.synchronization [req-0e2d4e1e-2db6-44a7-bd9c-e1387f7b7de7 req-25cbc9b4-278a-4ef4-b85b-4368ef89c0a4 service nova] Enqueued Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_members [ 1206.120787] env[69343]: INFO networking_nsxv3.common.synchronization [req-0e2d4e1e-2db6-44a7-bd9c-e1387f7b7de7 req-25cbc9b4-278a-4ef4-b85b-4368ef89c0a4 service nova] Enqueued Resource ID: fbb948d3-6d63-4b97-945d-768dfb6ff64b with Priority: HIGHEST for action port [ 1206.121881] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_rules [ 1206.122727] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_members [ 1206.122914] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbb948d3-6d63-4b97-945d-768dfb6ff64b with Priority: HIGHEST for action port [ 1206.123225] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.123374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.123429] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.123614] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.123691] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.124804] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.124941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.125046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.125185] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.125371] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.125431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.125497] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.125722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.125876] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.126019] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.127177] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbb948d3-6d63-4b97-945d-768dfb6ff64b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.127466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbb948d3-6d63-4b97-945d-768dfb6ff64b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.127466] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbb948d3-6d63-4b97-945d-768dfb6ff64b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.128076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbb948d3-6d63-4b97-945d-768dfb6ff64b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.128076] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbb948d3-6d63-4b97-945d-768dfb6ff64b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.630094] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.630247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.630457] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.631475] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbb948d3-6d63-4b97-945d-768dfb6ff64b with status ACTIVE [ 1206.632280] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.632280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.632280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.632280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.632515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.632685] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.632836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.632909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.633208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.633351] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.633621] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.633738] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.633790] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.633940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.634094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.634126] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbb948d3-6d63-4b97-945d-768dfb6ff64b is going to be updated. [ 1206.658984] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.659199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.659199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.659408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.659534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.659688] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbb948d3-6d63-4b97-945d-768dfb6ff64b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.136449] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.639326] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.639542] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.639595] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.639825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.639937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.640086] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8943f91-6f84-437f-912a-5f193b3365a6 is going to be updated. [ 1207.682834] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.683024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.683069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.683276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.683428] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.691610] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: IN_PROGRESS for 2s [ 1209.703615] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: SUCCESS [ 1209.703967] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.703967] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.704185] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.704385] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.704520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.704566] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.704742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.704828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.704931] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.705038] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.207393] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.208340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.208340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.208340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.208340] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.208340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.208340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.208340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.208642] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.208642] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.208708] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.208754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.208788] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.208937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.209086] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.209178] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.209238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.209584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.209671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.209765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.209860] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.712252] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8943f91-6f84-437f-912a-5f193b3365a6: rpc.has_security_group_logging(os_id): False [ 1210.734190] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.734190] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.734190] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.734532] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.734687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.734982] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.735206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.735269] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.735516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.735657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.735934] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.736064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.736213] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.736428] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.736548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.736792] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.736910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.737011] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.737235] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.737327] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.737441] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8943f91-6f84-437f-912a-5f193b3365a6 is going to be updated. [ 1210.823965] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.824202] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.824202] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.824393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.824543] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.840180] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: IN_PROGRESS for 2s [ 1211.124378] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1211.124378] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1211.817388] env[69343]: INFO networking_nsxv3.common.synchronization [req-384de409-c78a-4e07-8a7d-e536c4c76c76 req-90fef248-1974-4b25-84ba-0aab7b706def tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_members [ 1211.817388] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_members [ 1211.817881] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.817976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.818149] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.818448] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.818696] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.818856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.818950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.819208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.819355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.819501] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.229590] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.229886] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.230044] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.230323] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.230585] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.230751] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.230876] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.231223] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.231450] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.231717] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1212.231881] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1212.232045] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1212.232200] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1212.232544] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1212.232751] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1212.232958] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1212.252401] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1212.252650] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1212.252735] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1212.252905] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.253257] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-9fb8bf58-4e85-4630-a255-091f0aac0f9f taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.253433] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-9fb8bf58-4e85-4630-a255-091f0aac0f9f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.253557] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-9fb8bf58-4e85-4630-a255-091f0aac0f9f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.253911] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-9fb8bf58-4e85-4630-a255-091f0aac0f9f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.254216] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fb8bf58-4e85-4630-a255-091f0aac0f9f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.322169] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.757394] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.757643] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.757802] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.758168] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.758421] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.758671] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 9fb8bf58-4e85-4630-a255-091f0aac0f9f not found, creating... [ 1212.758971] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.759192] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.759303] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.759585] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.759757] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.763184] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.763507] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.763751] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.764149] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.764414] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.764650] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 9fb8bf58-4e85-4630-a255-091f0aac0f9f is going to be created. [ 1212.786683] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.787122] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.787122] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.787382] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.787627] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.787948] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-9fb8bf58-4e85-4630-a255-091f0aac0f9f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.824664] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.864976] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: SUCCESS [ 1212.864976] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.330024] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.330024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.330024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.330024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.330024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.330024] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 is going to be updated. [ 1213.363255] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.363508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.363638] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.363920] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.364189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.379770] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 in Status: IN_PROGRESS for 2s [ 1214.301028] env[69343]: INFO networking_nsxv3.common.synchronization [req-384de409-c78a-4e07-8a7d-e536c4c76c76 req-1f0af61b-41ad-450b-870a-95af3ece7cf4 service nova] Enqueued Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_rules [ 1214.301028] env[69343]: INFO networking_nsxv3.common.synchronization [req-384de409-c78a-4e07-8a7d-e536c4c76c76 req-1f0af61b-41ad-450b-870a-95af3ece7cf4 service nova] Enqueued Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_members [ 1214.301028] env[69343]: INFO networking_nsxv3.common.synchronization [req-384de409-c78a-4e07-8a7d-e536c4c76c76 req-1f0af61b-41ad-450b-870a-95af3ece7cf4 service nova] Enqueued Resource ID: 9fb8bf58-4e85-4630-a255-091f0aac0f9f with Priority: HIGHEST for action port [ 1214.301028] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_rules [ 1214.301715] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_members [ 1214.302034] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fb8bf58-4e85-4630-a255-091f0aac0f9f with Priority: HIGHEST for action port [ 1214.305019] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.305019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.305019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.305019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.305019] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.305019] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.305019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.305019] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fb8bf58-4e85-4630-a255-091f0aac0f9f taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.305019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fb8bf58-4e85-4630-a255-091f0aac0f9f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.305019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fb8bf58-4e85-4630-a255-091f0aac0f9f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.305019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fb8bf58-4e85-4630-a255-091f0aac0f9f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.305019] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fb8bf58-4e85-4630-a255-091f0aac0f9f',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.697541] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-551 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.697782] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-551" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.697931] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-551" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.698237] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-551" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.698549] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.698764] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.698909] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.699247] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.699550] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.699852] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.700071] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1214.700196] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1214.700353] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1214.700504] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.700623] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1214.700728] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1214.723435] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1214.723735] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1214.723853] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1214.724018] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-551" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.724417] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-171fa31b-ba9b-49f3-9f39-d36d3260bda9 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.724714] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-171fa31b-ba9b-49f3-9f39-d36d3260bda9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.724863] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-171fa31b-ba9b-49f3-9f39-d36d3260bda9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.725206] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-171fa31b-ba9b-49f3-9f39-d36d3260bda9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.725330] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('171fa31b-ba9b-49f3-9f39-d36d3260bda9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.809965] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.810171] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.813744] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fb8bf58-4e85-4630-a255-091f0aac0f9f with status ACTIVE [ 1214.815544] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.815544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.815544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.815544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.815544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.815544] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.815544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.815544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.815544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.815544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.815544] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.815544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.815544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.816122] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.816122] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.816122] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fb8bf58-4e85-4630-a255-091f0aac0f9f is going to be updated. [ 1214.843103] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.843456] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.843456] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.843604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.843732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.843972] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fb8bf58-4e85-4630-a255-091f0aac0f9f" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.228251] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.228543] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.228744] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.229118] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.229304] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.229656] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.229899] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.230064] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.230310] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.230462] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.230776] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.230942] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.231141] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.231710] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.231710] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.231710] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 171fa31b-ba9b-49f3-9f39-d36d3260bda9 is going to be updated. [ 1215.255642] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.255932] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.256124] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.256454] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.256669] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.256954] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-171fa31b-ba9b-49f3-9f39-d36d3260bda9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.394476] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 in Status: SUCCESS [ 1215.394929] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.395754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.395754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.395754] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.395975] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.396075] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.396357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.396499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.396669] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.900317] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.965959] env[69343]: INFO networking_nsxv3.common.synchronization [req-c8364a19-6071-492e-9513-2cb48210d2be req-1ce8ed70-f183-49b6-96b8-566143fc5ba4 service nova] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_rules [ 1215.966188] env[69343]: INFO networking_nsxv3.common.synchronization [req-c8364a19-6071-492e-9513-2cb48210d2be req-1ce8ed70-f183-49b6-96b8-566143fc5ba4 service nova] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 1215.966330] env[69343]: INFO networking_nsxv3.common.synchronization [req-c8364a19-6071-492e-9513-2cb48210d2be req-1ce8ed70-f183-49b6-96b8-566143fc5ba4 service nova] Enqueued Resource ID: 171fa31b-ba9b-49f3-9f39-d36d3260bda9 with Priority: HIGHEST for action port [ 1215.966802] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_rules [ 1215.966935] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 1215.967061] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171fa31b-ba9b-49f3-9f39-d36d3260bda9 with Priority: HIGHEST for action port [ 1215.967343] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.967464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.967531] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.967723] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.967803] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.969381] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.969494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.969561] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.969720] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.969877] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.969964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.970036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.970180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.970268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.970354] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.971459] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-171fa31b-ba9b-49f3-9f39-d36d3260bda9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.971567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-171fa31b-ba9b-49f3-9f39-d36d3260bda9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.971635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-171fa31b-ba9b-49f3-9f39-d36d3260bda9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.971782] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-171fa31b-ba9b-49f3-9f39-d36d3260bda9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.971858] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('171fa31b-ba9b-49f3-9f39-d36d3260bda9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.402546] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.472076] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.473449] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.473639] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.473799] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 171fa31b-ba9b-49f3-9f39-d36d3260bda9 with status ACTIVE [ 1216.473945] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.474114] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.474208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.474426] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.474552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.474820] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.474973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.475071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.475306] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.475611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.475611] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.475755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.475881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.476019] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.476111] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.476196] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 171fa31b-ba9b-49f3-9f39-d36d3260bda9 is going to be updated. [ 1216.504942] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.505151] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.505194] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.505425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.505607] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.505778] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-171fa31b-ba9b-49f3-9f39-d36d3260bda9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.905427] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.905695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.905785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.906193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.906341] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.906500] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 is going to be updated. [ 1216.943789] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.943960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.944047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.944383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.944544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.961083] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 in Status: IN_PROGRESS for 2s [ 1216.979188] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.481669] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.482106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.482106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.482238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.482339] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.482461] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 is going to be updated. [ 1217.518042] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.518184] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.519040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.519040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.519040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.528531] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: IN_PROGRESS for 2s [ 1218.972304] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 in Status: SUCCESS [ 1218.972714] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.972803] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.972988] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.973214] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.973350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.973426] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.973557] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.973666] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.973774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.973874] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.335537] env[69343]: INFO networking_nsxv3.common.synchronization [req-c850c4a6-f7c9-4c84-bc07-4b0902f2532b req-5d818102-b28b-4f2b-9bd0-2e19b69ad793 tempest-DeleteServersTestJSON-1417757124 tempest-DeleteServersTestJSON-1417757124-project-member] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1219.336248] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1219.336632] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.336792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.336862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.337122] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.337324] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.337457] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.337544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.337717] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.337799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.337898] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.476127] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.538844] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: SUCCESS [ 1219.539136] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.539323] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.539567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.539778] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.539916] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.539987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.540189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.540277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.540385] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.540481] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.839975] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.840249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.840249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.840663] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.840663] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.840845] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.841027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.841098] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.841231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.841304] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.841410] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1219.873214] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.873362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.873362] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.873634] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.873961] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.883579] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1219.978802] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293: rpc.has_security_group_logging(os_id): False [ 1219.998722] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.998905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.998999] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.999276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.999383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.999670] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.000290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.000290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.000290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.000290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.000531] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 is going to be updated. [ 1220.042429] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.068761] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.068910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.068983] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.069213] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.069360] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.091700] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 in Status: IN_PROGRESS for 2s [ 1220.545448] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 970edbb8-6a58-46c8-ad52-fe607c6c28e9: rpc.has_security_group_logging(os_id): False [ 1220.565831] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.566025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.566089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.566295] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.566453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.566753] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.566753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.566895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.566945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.567008] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.567110] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 is going to be updated. [ 1220.641305] env[69343]: INFO networking_nsxv3.common.synchronization [req-1c0b29d5-9553-410d-9f71-6a2978183583 req-42472f1d-ef36-4451-8fe8-c793c5ef9eae tempest-ServerActionsTestJSON-1397784852 tempest-ServerActionsTestJSON-1397784852-project-member] Enqueued Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 1220.641983] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 1220.642344] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.642494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.642575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.643132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.643731] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.643731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.643731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.643989] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.643989] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.643989] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.659749] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.659910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.659950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.660167] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.660311] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.677604] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: IN_PROGRESS for 2s [ 1221.146076] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.146449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.146449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.146610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.146665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.146845] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.147035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.147035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.147986] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.148166] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.148312] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 is going to be updated. [ 1221.176698] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.176879] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.176990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.177285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.177471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.186533] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: IN_PROGRESS for 2s [ 1221.895889] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1221.896157] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e deletion is rescheduled due to dependency. [ 1221.896273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.112465] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 in Status: SUCCESS [ 1222.112465] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.695639] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: SUCCESS [ 1222.696141] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.916433] env[69343]: INFO networking_nsxv3.common.synchronization [req-9b76a3e1-4024-4be7-966b-febe839b46b5 req-148bc013-7c7c-409b-8d1d-7e661510e124 tempest-ServerActionsTestOtherA-678333832 tempest-ServerActionsTestOtherA-678333832-project-member] Enqueued Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_members [ 1222.916998] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGHEST for action security_group_members [ 1222.917337] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.917461] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.917558] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.917766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.917963] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.918044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.918130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.918249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.918333] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.918464] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.198989] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: SUCCESS [ 1223.199234] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 deletion is rescheduled due to dependency. [ 1223.199389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.421763] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.422088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.422088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.422438] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.422582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.422966] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.423117] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.423410] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.423497] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.423540] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.423756] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc is going to be updated. [ 1223.460267] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.460267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.460267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.460267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.460267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.474391] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: IN_PROGRESS for 2s [ 1225.487226] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc in Status: SUCCESS [ 1225.487593] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc deletion is rescheduled due to dependency. [ 1225.487665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.645962] env[69343]: INFO networking_nsxv3.common.synchronization [None req-d714f815-4283-41a7-8454-8f6b19839ddc tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1225.646544] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1225.646875] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.647014] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.647131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.647285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.647526] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.647641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.647706] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.647982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.647982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.648109] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.152559] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.152559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.152559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.152559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.152559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.152559] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.152559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.152559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.152559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.152559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.152559] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be updated. [ 1226.182158] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.182158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.182158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.182158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.182158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.190900] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: IN_PROGRESS for 2s [ 1226.692342] env[69343]: INFO networking_nsxv3.common.synchronization [req-19c110d7-aadc-48af-b27c-ae54cc48935b req-c16b4205-ba83-436a-a8aa-81fcfcd84399 tempest-ServerRescueTestJSON-142228568 tempest-ServerRescueTestJSON-142228568-project-member] Enqueued Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGHEST for action security_group_members [ 1226.693383] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGHEST for action security_group_members [ 1226.695094] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe57526-4a38-4213-b086-d05377278315 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.695094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.695094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.695094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.695094] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.695094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.695094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.695094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.695094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.695094] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.199716] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.469127] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-911 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.470018] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-911" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.470018] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-911" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.470212] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-911" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.470600] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.470936] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.471193] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.474093] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.474093] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.474093] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1227.474093] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1227.474093] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1227.474093] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1227.474093] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1227.474093] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1227.474093] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1227.504718] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1227.504718] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1227.504718] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1227.505195] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-911" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.505383] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-dac21b83-4ad9-4756-b896-0b83569f5941 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.507041] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-dac21b83-4ad9-4756-b896-0b83569f5941" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.507041] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-dac21b83-4ad9-4756-b896-0b83569f5941" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.507041] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-dac21b83-4ad9-4756-b896-0b83569f5941" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.507041] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dac21b83-4ad9-4756-b896-0b83569f5941',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.701656] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.009698] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.009988] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.010075] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.010370] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.010540] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.010824] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port dac21b83-4ad9-4756-b896-0b83569f5941 not found, creating... [ 1228.011052] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.011232] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.011358] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.013370] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.013370] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.013370] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.013370] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.013370] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.013370] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.013370] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.013370] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: dac21b83-4ad9-4756-b896-0b83569f5941 is going to be created. [ 1228.040617] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.040839] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.040944] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.041261] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.041488] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.041713] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-dac21b83-4ad9-4756-b896-0b83569f5941" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.204033] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1228.204033] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 deletion is rescheduled due to dependency. [ 1228.204033] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.204360] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.204505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.204581] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.204895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.205501] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.205501] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fe57526-4a38-4213-b086-d05377278315 is going to be updated. [ 1228.248917] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.249130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.249130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.249286] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.249439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.260436] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fe57526-4a38-4213-b086-d05377278315 in Status: IN_PROGRESS for 2s [ 1228.747421] env[69343]: INFO networking_nsxv3.common.synchronization [req-19c110d7-aadc-48af-b27c-ae54cc48935b req-e26e2406-a6ac-42d9-b4b9-3cb8abbeb424 service nova] Enqueued Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGHEST for action security_group_rules [ 1228.748015] env[69343]: INFO networking_nsxv3.common.synchronization [req-19c110d7-aadc-48af-b27c-ae54cc48935b req-e26e2406-a6ac-42d9-b4b9-3cb8abbeb424 service nova] Enqueued Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGHEST for action security_group_members [ 1228.748015] env[69343]: INFO networking_nsxv3.common.synchronization [req-19c110d7-aadc-48af-b27c-ae54cc48935b req-e26e2406-a6ac-42d9-b4b9-3cb8abbeb424 service nova] Enqueued Resource ID: dac21b83-4ad9-4756-b896-0b83569f5941 with Priority: HIGHEST for action port [ 1228.748015] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGHEST for action security_group_rules [ 1228.748788] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGHEST for action security_group_members [ 1228.748788] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac21b83-4ad9-4756-b896-0b83569f5941 with Priority: HIGHEST for action port [ 1228.749158] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fe57526-4a38-4213-b086-d05377278315 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.749158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.749158] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.749360] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.749360] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.752076] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe57526-4a38-4213-b086-d05377278315 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.752076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.752076] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-dac21b83-4ad9-4756-b896-0b83569f5941 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.752076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dac21b83-4ad9-4756-b896-0b83569f5941" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.752076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dac21b83-4ad9-4756-b896-0b83569f5941" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.752076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dac21b83-4ad9-4756-b896-0b83569f5941" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.752076] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dac21b83-4ad9-4756-b896-0b83569f5941',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.256707] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe57526-4a38-4213-b086-d05377278315 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.257057] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.257433] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dac21b83-4ad9-4756-b896-0b83569f5941 with status ACTIVE [ 1229.257691] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.257883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.257982] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.258955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.259157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.259262] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.259388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.259456] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.259728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.259728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.259935] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.260024] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.260104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.260227] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.260301] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.260392] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dac21b83-4ad9-4756-b896-0b83569f5941 is going to be updated. [ 1229.284057] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.284057] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.284057] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.284383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.284383] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.284462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dac21b83-4ad9-4756-b896-0b83569f5941" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.273076] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fe57526-4a38-4213-b086-d05377278315 in Status: SUCCESS [ 1230.273459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.273459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.273747] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.274092] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.274349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.274463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.274739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.274919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.275118] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.778942] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.281858] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.785084] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.785084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.785084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.785084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.785084] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.785084] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fe57526-4a38-4213-b086-d05377278315 is going to be updated. [ 1231.814438] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.814587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.814661] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.814938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.815201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.824828] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fe57526-4a38-4213-b086-d05377278315 in Status: IN_PROGRESS for 2s [ 1233.063854] env[69343]: INFO networking_nsxv3.common.synchronization [req-28ab0731-a410-4664-9e17-f6d4488df520 req-7737bdd3-a783-4fc5-81de-dfc5af1826c7 tempest-DeleteServersTestJSON-1417757124 tempest-DeleteServersTestJSON-1417757124-project-member] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1233.067887] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1233.067887] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.067887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.067887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.067887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.067887] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.067887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.067887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.067887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.067887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.067887] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.574924] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.574924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.574924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.575222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.575308] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.575496] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.575589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.575646] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.575804] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.575887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.575987] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1233.613350] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-284 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.613816] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.613816] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.613953] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.617646] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.617646] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.617646] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.617646] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.617646] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.617646] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1233.617646] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1233.617646] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1233.618132] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1233.618132] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1233.618132] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1233.618132] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1233.623734] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.623923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.623923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.624174] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.624292] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.641994] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1233.661735] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1233.661940] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1233.663552] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1233.663552] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.663552] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-7c53839f-fc68-4b62-b4aa-2ad714311e42 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.663552] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-7c53839f-fc68-4b62-b4aa-2ad714311e42" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.663552] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-7c53839f-fc68-4b62-b4aa-2ad714311e42" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.663552] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-7c53839f-fc68-4b62-b4aa-2ad714311e42" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.664011] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c53839f-fc68-4b62-b4aa-2ad714311e42',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.835781] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fe57526-4a38-4213-b086-d05377278315 in Status: SUCCESS [ 1233.836077] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.836255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.836477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.836690] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.836804] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.836870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.837093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.837189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.837298] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.837558] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.166664] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.167110] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.167290] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.167752] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.167892] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.168200] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 7c53839f-fc68-4b62-b4aa-2ad714311e42 not found, creating... [ 1234.168536] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.168751] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.168913] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.169251] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.169429] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.169780] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.170019] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.170190] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.170739] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.170848] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.171040] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 7c53839f-fc68-4b62-b4aa-2ad714311e42 is going to be created. [ 1234.194525] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.194806] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.194958] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.195322] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.195568] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.195875] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-7c53839f-fc68-4b62-b4aa-2ad714311e42" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.339812] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe57526-4a38-4213-b086-d05377278315 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.340054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.340054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.340297] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.340476] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.340580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.340648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.340804] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.340893] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.340985] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.341151] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe57526-4a38-4213-b086-d05377278315 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.341242] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.341303] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.341576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.341715] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.341808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.341870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.342018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.342110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.342196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.342287] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.847249] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fe57526-4a38-4213-b086-d05377278315: rpc.has_security_group_logging(os_id): False [ 1234.864145] env[69343]: INFO networking_nsxv3.common.synchronization [req-28ab0731-a410-4664-9e17-f6d4488df520 req-612f841a-83ee-4a51-becd-b85cabdf72db service nova] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_rules [ 1234.864558] env[69343]: INFO networking_nsxv3.common.synchronization [req-28ab0731-a410-4664-9e17-f6d4488df520 req-612f841a-83ee-4a51-becd-b85cabdf72db service nova] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1234.864746] env[69343]: INFO networking_nsxv3.common.synchronization [req-28ab0731-a410-4664-9e17-f6d4488df520 req-612f841a-83ee-4a51-becd-b85cabdf72db service nova] Enqueued Resource ID: 7c53839f-fc68-4b62-b4aa-2ad714311e42 with Priority: HIGHEST for action port [ 1234.866334] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.866815] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.866894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.867429] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.867556] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.867972] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.868097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.868165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.868336] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.868416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.868929] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.869317] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.869389] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.869547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.869627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.870457] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.870587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.870660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.870836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.870921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.871061] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fe57526-4a38-4213-b086-d05377278315 is going to be updated. [ 1234.872668] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_rules [ 1234.872799] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1234.872899] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c53839f-fc68-4b62-b4aa-2ad714311e42 with Priority: HIGHEST for action port [ 1234.873552] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.873689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.873773] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.873950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.874113] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.875075] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.875175] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.875397] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c53839f-fc68-4b62-b4aa-2ad714311e42 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.875547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c53839f-fc68-4b62-b4aa-2ad714311e42" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.875614] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c53839f-fc68-4b62-b4aa-2ad714311e42" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.876047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c53839f-fc68-4b62-b4aa-2ad714311e42" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.876047] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c53839f-fc68-4b62-b4aa-2ad714311e42',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.936474] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.936684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.936684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.936897] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.937076] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.970441] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fe57526-4a38-4213-b086-d05377278315 in Status: IN_PROGRESS for 2s [ 1235.378492] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c53839f-fc68-4b62-b4aa-2ad714311e42 with status ACTIVE [ 1235.378813] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.378881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.378979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.379180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.379273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.379469] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.379574] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.379686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.379780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.379871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.380052] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.380143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.380206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.380343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.380418] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.380509] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c53839f-fc68-4b62-b4aa-2ad714311e42 is going to be updated. [ 1235.381986] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.382132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.405780] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.405989] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.406045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.406375] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.406611] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.406857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c53839f-fc68-4b62-b4aa-2ad714311e42" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.655028] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1235.655028] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e deletion is rescheduled due to dependency. [ 1235.655028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.655028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.655028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.655028] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.655028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.655028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.655028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.655028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.655028] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.966150] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.966150] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.966150] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.966150] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.967132] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.967838] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.967838] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.968046] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.968329] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.972254] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.972512] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1235.972871] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1235.973090] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1235.973887] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.973887] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1235.973887] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1236.000202] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1236.000371] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1236.000516] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1236.000703] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.001038] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-c881f573-c3d0-42ce-a18e-b14fbfe61362 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.001227] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-c881f573-c3d0-42ce-a18e-b14fbfe61362" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.001374] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-c881f573-c3d0-42ce-a18e-b14fbfe61362" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.001706] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-c881f573-c3d0-42ce-a18e-b14fbfe61362" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.001851] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c881f573-c3d0-42ce-a18e-b14fbfe61362',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.159868] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.505339] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.505594] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.505726] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.506030] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.506206] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.506371] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port c881f573-c3d0-42ce-a18e-b14fbfe61362 not found, creating... [ 1236.506638] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.506831] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.506919] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.507172] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.507326] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.507605] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.507767] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.507908] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.508147] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.508280] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.508655] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: c881f573-c3d0-42ce-a18e-b14fbfe61362 is going to be created. [ 1236.534663] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.535035] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.535277] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.535644] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.535828] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.536103] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-c881f573-c3d0-42ce-a18e-b14fbfe61362" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.661801] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.847946] env[69343]: INFO networking_nsxv3.common.synchronization [req-5e4dfe38-245b-4a6a-91c0-8da525ecd756 req-becc5f6e-f6f7-41a5-a9b4-11e7d878944a tempest-ServerActionsTestJSON-1397784852 tempest-ServerActionsTestJSON-1397784852-project-member] Enqueued Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 1236.848630] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 1236.849399] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.849399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.849399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.849608] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.849781] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.849912] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.849981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.850210] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.850329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.850437] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.984925] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fe57526-4a38-4213-b086-d05377278315 in Status: SUCCESS [ 1236.985259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.165942] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.166131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.166275] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.166460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.166596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.166749] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1237.197353] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.197522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.197579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.197788] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.197937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.208300] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1237.352865] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.353080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.353181] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.353440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.353546] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.353705] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.353832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.353892] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.354653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.354801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.354907] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 is going to be updated. [ 1237.391395] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.391665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.391665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.391892] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.391943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.406023] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: IN_PROGRESS for 2s [ 1237.575896] env[69343]: INFO networking_nsxv3.common.synchronization [req-991e54a1-f783-42f3-82de-7d674d088c5e req-73b4e921-397c-434f-8646-339355e86c13 service nova] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_rules [ 1237.576116] env[69343]: INFO networking_nsxv3.common.synchronization [req-991e54a1-f783-42f3-82de-7d674d088c5e req-73b4e921-397c-434f-8646-339355e86c13 service nova] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1237.576274] env[69343]: INFO networking_nsxv3.common.synchronization [req-991e54a1-f783-42f3-82de-7d674d088c5e req-73b4e921-397c-434f-8646-339355e86c13 service nova] Enqueued Resource ID: c881f573-c3d0-42ce-a18e-b14fbfe61362 with Priority: HIGHEST for action port [ 1237.577130] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.577320] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-988" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.577448] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-988" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.577710] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-988" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.577972] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.578817] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.578988] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.579259] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.579419] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.579699] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1237.579861] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1237.579986] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1237.580113] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1237.580266] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1237.580372] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1237.580493] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1237.583295] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_rules [ 1237.583356] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1237.583466] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c881f573-c3d0-42ce-a18e-b14fbfe61362 with Priority: HIGHEST for action port [ 1237.584331] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.584434] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.584434] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.584696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.584696] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.585682] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.585810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.585863] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.587264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.587359] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.587476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.587541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.587698] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.587785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.587876] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.588954] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-c881f573-c3d0-42ce-a18e-b14fbfe61362 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.589077] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c881f573-c3d0-42ce-a18e-b14fbfe61362" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.589138] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c881f573-c3d0-42ce-a18e-b14fbfe61362" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.589316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c881f573-c3d0-42ce-a18e-b14fbfe61362" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.589390] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c881f573-c3d0-42ce-a18e-b14fbfe61362',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.609611] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1237.609792] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1237.609903] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1237.613926] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-988" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.613926] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-1cf145b5-fc3f-4654-8444-f70f347402d0 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.613926] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-1cf145b5-fc3f-4654-8444-f70f347402d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.613926] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-1cf145b5-fc3f-4654-8444-f70f347402d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.613926] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-1cf145b5-fc3f-4654-8444-f70f347402d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.613926] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cf145b5-fc3f-4654-8444-f70f347402d0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.091551] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.092722] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.092883] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.093134] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c881f573-c3d0-42ce-a18e-b14fbfe61362 with status ACTIVE [ 1238.093303] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.093424] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.093495] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.093716] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.093807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.093992] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.094106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.094182] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.094370] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.094452] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.094634] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.094729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.094795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.095038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.095557] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.095711] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c881f573-c3d0-42ce-a18e-b14fbfe61362 is going to be updated. [ 1238.116492] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.116801] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.116977] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.117336] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.117553] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.117968] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 1cf145b5-fc3f-4654-8444-f70f347402d0 not found, creating... [ 1238.118727] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.119102] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.119281] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.119585] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.119787] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.120162] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.120393] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.120559] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.120843] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.121048] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.121239] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 1cf145b5-fc3f-4654-8444-f70f347402d0 is going to be created. [ 1238.137456] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.137670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.137748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.138035] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.138264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.138488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c881f573-c3d0-42ce-a18e-b14fbfe61362" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.159824] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.159824] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.159824] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.160358] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.160781] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.161213] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-1cf145b5-fc3f-4654-8444-f70f347402d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.470676] env[69343]: INFO networking_nsxv3.common.synchronization [req-8c0efafb-80db-48fa-83b6-52b7152b3e92 req-0bf95274-7ae8-4faa-a7b9-92c5097aea3a tempest-ServerActionsTestOtherB-1339566970 tempest-ServerActionsTestOtherB-1339566970-project-member] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 1238.471176] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGHEST for action security_group_members [ 1238.471504] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.471626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.471692] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.471889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.472059] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.472841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.472841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.472841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.472841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.472841] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.599435] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.643097] env[69343]: INFO networking_nsxv3.common.synchronization [req-786785d1-195d-4bcd-a0b5-66f5113e52d0 req-dc2c744f-8d6d-42b4-b62f-4c8e03ab4b88 tempest-ServersNegativeTestJSON-949345807 tempest-ServersNegativeTestJSON-949345807-project-member] Enqueued Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_members [ 1238.643097] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGHEST for action security_group_members [ 1238.643097] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.643097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.643097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.643097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.643097] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.643097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.643787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.644070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.644287] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.644481] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.976433] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.976701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.976701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.976909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.977025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.977227] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.977342] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.977403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.977541] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.977621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.978122] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 is going to be updated. [ 1239.013896] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.013896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.013896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.013896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.013896] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.022391] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: IN_PROGRESS for 2s [ 1239.101658] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.101901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.101901] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.102230] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.102334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.102436] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be updated. [ 1239.131284] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.131493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.131493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.131708] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.131852] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.141502] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: IN_PROGRESS for 2s [ 1239.152246] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.152246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.152246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.152246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.152246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.152246] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.152246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.152246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.152246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.152246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.152246] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8943f91-6f84-437f-912a-5f193b3365a6 is going to be updated. [ 1239.187586] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.187586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.187586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.187586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.187586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.198471] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: IN_PROGRESS for 2s [ 1239.218126] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1239.218349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.218804] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.218804] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.218920] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.219065] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.219137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.219298] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.219381] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.219465] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.219559] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.416834] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: SUCCESS [ 1239.417060] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 deletion is rescheduled due to dependency. [ 1239.417233] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.601864] env[69343]: INFO networking_nsxv3.common.synchronization [req-5e4dfe38-245b-4a6a-91c0-8da525ecd756 req-decede76-272a-43ab-a04e-10dffb8a14ab service nova] Enqueued Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_rules [ 1239.602308] env[69343]: INFO networking_nsxv3.common.synchronization [req-5e4dfe38-245b-4a6a-91c0-8da525ecd756 req-decede76-272a-43ab-a04e-10dffb8a14ab service nova] Enqueued Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 1239.602308] env[69343]: INFO networking_nsxv3.common.synchronization [req-5e4dfe38-245b-4a6a-91c0-8da525ecd756 req-decede76-272a-43ab-a04e-10dffb8a14ab service nova] Enqueued Resource ID: 1cf145b5-fc3f-4654-8444-f70f347402d0 with Priority: HIGHEST for action port [ 1239.602434] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_rules [ 1239.602561] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 1239.602659] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf145b5-fc3f-4654-8444-f70f347402d0 with Priority: HIGHEST for action port [ 1239.603434] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.603567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.603663] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.603818] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.603900] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.605181] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.605310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.605363] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.605520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.605666] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.605759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.605847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.605962] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.606060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.606154] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.607290] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cf145b5-fc3f-4654-8444-f70f347402d0 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.607397] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cf145b5-fc3f-4654-8444-f70f347402d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.607463] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cf145b5-fc3f-4654-8444-f70f347402d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.607621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cf145b5-fc3f-4654-8444-f70f347402d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.607793] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cf145b5-fc3f-4654-8444-f70f347402d0',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.724530] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.724759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.724759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.724972] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.725559] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.725706] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.725755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.725936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.726040] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.726165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.726365] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.726502] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.726600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.726822] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.727024] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.727129] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.727194] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.727400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.727503] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.727593] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.727684] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.105893] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.106111] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.107562] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.109368] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1cf145b5-fc3f-4654-8444-f70f347402d0 with status ACTIVE [ 1240.109571] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.109697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.109771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.109995] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.110107] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.110304] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.110408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.110484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.110670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.110755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.110962] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.111081] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.111135] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.111328] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.111398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.111450] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1cf145b5-fc3f-4654-8444-f70f347402d0 is going to be updated. [ 1240.134342] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.134506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.134550] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.134758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.134907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.135148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cf145b5-fc3f-4654-8444-f70f347402d0" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.233459] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c336180-c6d8-473b-8306-38646bd8e00e: rpc.has_security_group_logging(os_id): False [ 1240.255945] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.256173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.256268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.256509] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.256607] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.256846] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.256946] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.257056] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.257343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.257417] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.257631] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.257739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.257825] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.257998] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.258125] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.258348] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.258460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.258545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.258714] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.258796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.258910] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1240.357743] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.357914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.357995] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.358251] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.358437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.370759] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1240.610346] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.031335] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 in Status: SUCCESS [ 1241.031564] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 deletion is rescheduled due to dependency. [ 1241.031696] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.112471] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.112641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.112743] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.112996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.113132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.113241] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 is going to be updated. [ 1241.144705] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.144878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.144942] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.146364] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.146531] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.156419] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1241.156757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.156757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.157046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.157393] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.157393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.157528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.157641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.157748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.157890] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.158015] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.159683] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: IN_PROGRESS for 2s [ 1241.211142] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8943f91-6f84-437f-912a-5f193b3365a6 in Status: SUCCESS [ 1241.211142] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8943f91-6f84-437f-912a-5f193b3365a6 deletion is rescheduled due to dependency. [ 1241.211142] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.660968] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.661260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.661260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.661410] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.661586] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.661689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.661756] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.661910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.662018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.662324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.662324] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.662324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.662506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.662546] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.662656] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.662748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.662808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.663050] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.663131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.663215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.663307] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.166318] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e6e2d6-f175-4be9-be9a-bdb1208e0e04: rpc.has_security_group_logging(os_id): False [ 1242.185217] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.185367] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.185444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.185644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.185737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.185949] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.186064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.186145] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.186455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.186455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.186582] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.186667] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.186729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.186841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.186911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.187281] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.187281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.187281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.187444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.187444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.187556] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be updated. [ 1242.250359] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.250554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.250687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.250882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.251086] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.264218] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: IN_PROGRESS for 2s [ 1242.388099] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1242.388288] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.169499] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: SUCCESS [ 1243.169857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.169974] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.170361] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.170588] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.170753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.170871] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.171082] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.171195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.171308] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.171413] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.674128] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.176552] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ceec863-0a7a-401b-a8e8-048823180971: rpc.has_security_group_logging(os_id): False [ 1244.195178] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.196088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.196301] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.196570] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.197130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.197218] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.197365] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.197470] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.197906] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.198073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.198220] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 is going to be updated. [ 1244.255431] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.255576] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.255644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.255856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.255999] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.267824] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: IN_PROGRESS for 2s [ 1244.276829] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1244.277238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.604570] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1244.604570] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1246.204847] env[69343]: INFO networking_nsxv3.common.synchronization [req-12fe57b5-e990-4e4c-9a88-bf81f48b07fc req-70063ef3-1234-41c3-b85a-4f844694fa2c tempest-DeleteServersTestJSON-1417757124 tempest-DeleteServersTestJSON-1417757124-project-member] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1246.205634] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1246.206029] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.206220] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.206299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.206497] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.206671] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.206795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.206854] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.206968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.207069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.207209] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.282664] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: SUCCESS [ 1246.282910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.709976] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.710189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.710236] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.710938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.710938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.710938] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.710938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.710938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.711310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.711310] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.711310] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1246.741730] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.741934] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.741934] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.742133] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.742237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.751799] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1248.770909] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1248.771326] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e deletion is rescheduled due to dependency. [ 1248.771326] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.207145] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1251.207531] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1252.477225] env[69343]: INFO networking_nsxv3.common.synchronization [req-d062100f-11b9-41a6-b027-d97434f3bbb6 req-5d2586d6-5a00-4907-8fc3-51fd23ba9491 tempest-AttachVolumeShelveTestJSON-1111703815 tempest-AttachVolumeShelveTestJSON-1111703815-project-member] Enqueued Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGHEST for action security_group_members [ 1252.477225] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGHEST for action security_group_members [ 1252.477225] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bec412e-0e1e-4a5b-8816-552633942519 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.477225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.477225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.477225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.477225] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.477225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.477225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.477819] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.477990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.478182] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.980802] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.983801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.983801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.983801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.983801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.983801] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.983801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.983801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.983801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.983801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.983801] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bec412e-0e1e-4a5b-8816-552633942519 is going to be updated. [ 1253.013140] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.013140] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.013140] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.013140] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.013140] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.020431] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bec412e-0e1e-4a5b-8816-552633942519 in Status: IN_PROGRESS for 2s [ 1253.475127] env[69343]: INFO networking_nsxv3.common.synchronization [None req-c2057633-0d32-4d70-9c51-a09e466bb69d None None] Enqueued Resource ID: 8393700e-0dfe-487b-82c7-05b1b3d2ffcb with Priority: HIGHEST for action port [ 1253.475127] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8393700e-0dfe-487b-82c7-05b1b3d2ffcb with Priority: HIGHEST for action port [ 1253.475127] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-8393700e-0dfe-487b-82c7-05b1b3d2ffcb taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.475127] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8393700e-0dfe-487b-82c7-05b1b3d2ffcb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.475127] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8393700e-0dfe-487b-82c7-05b1b3d2ffcb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.475127] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8393700e-0dfe-487b-82c7-05b1b3d2ffcb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.475127] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8393700e-0dfe-487b-82c7-05b1b3d2ffcb',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.982807] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8393700e-0dfe-487b-82c7-05b1b3d2ffcb [ 1253.982807] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.982807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.982807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.982807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.982807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.982807] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8393700e-0dfe-487b-82c7-05b1b3d2ffcb already deleted. [ 1253.982807] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8393700e-0dfe-487b-82c7-05b1b3d2ffcb" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.570193] env[69343]: INFO networking_nsxv3.common.synchronization [req-424d42e6-d92f-420c-8815-477d393c4ab5 req-2ea6bcf3-02dd-4e05-b7ca-578f35d00282 tempest-ServerRescueTestJSON-142228568 tempest-ServerRescueTestJSON-142228568-project-member] Enqueued Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGHEST for action security_group_members [ 1254.570780] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGHEST for action security_group_members [ 1254.571110] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe57526-4a38-4213-b086-d05377278315 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.571232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.571296] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.571485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.572536] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.573639] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.573639] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.573639] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.573639] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.573639] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.033715] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bec412e-0e1e-4a5b-8816-552633942519 in Status: SUCCESS [ 1255.033715] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bec412e-0e1e-4a5b-8816-552633942519 deletion is rescheduled due to dependency. [ 1255.034673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.043361] env[69343]: INFO networking_nsxv3.common.synchronization [None req-245f6908-65ba-4218-a6f7-e1dbbcf1a3ee None None] Enqueued Resource ID: 44a97767-5606-4236-97ca-7347ff712686 with Priority: HIGHEST for action port [ 1255.043740] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44a97767-5606-4236-97ca-7347ff712686 with Priority: HIGHEST for action port [ 1255.044407] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-44a97767-5606-4236-97ca-7347ff712686 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.044542] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44a97767-5606-4236-97ca-7347ff712686" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.044598] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44a97767-5606-4236-97ca-7347ff712686" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.044880] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44a97767-5606-4236-97ca-7347ff712686" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.044966] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44a97767-5606-4236-97ca-7347ff712686',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.074779] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.406201] env[69343]: INFO networking_nsxv3.common.synchronization [req-05d407fe-2958-4803-862a-19a4de6a8b60 req-5be32ec1-f41e-49b3-8a85-b05ff9619fb8 tempest-DeleteServersTestJSON-1417757124 tempest-DeleteServersTestJSON-1417757124-project-member] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1255.406201] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1255.406201] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.406519] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.406672] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.406980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.407269] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.407512] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.407713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.408036] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.408276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.408562] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.551013] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44a97767-5606-4236-97ca-7347ff712686 [ 1255.551013] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.551013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.551013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.551013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.551013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.551013] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44a97767-5606-4236-97ca-7347ff712686 already deleted. [ 1255.551013] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44a97767-5606-4236-97ca-7347ff712686" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.578841] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.833188] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-284 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.833412] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.833539] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.833808] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.834074] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.834228] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.834496] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.834555] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.834727] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.834905] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1255.835301] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1255.835483] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1255.835676] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1255.835727] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1255.835883] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1255.836539] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1255.857637] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1255.857807] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1255.858104] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1255.858201] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.858455] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-b3aeeeb6-925c-4ec0-bb63-134b42cf98b5 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.858698] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-b3aeeeb6-925c-4ec0-bb63-134b42cf98b5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.858883] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-b3aeeeb6-925c-4ec0-bb63-134b42cf98b5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.859240] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-b3aeeeb6-925c-4ec0-bb63-134b42cf98b5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.859385] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3aeeeb6-925c-4ec0-bb63-134b42cf98b5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.881085] env[69343]: INFO networking_nsxv3.common.synchronization [None req-30ce09a7-dc17-46db-8b75-b6cc1ff279e7 None None] Enqueued Resource ID: 169a4485-3dc4-41fd-9a06-2f0786d88690 with Priority: HIGHEST for action port [ 1255.881593] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 169a4485-3dc4-41fd-9a06-2f0786d88690 with Priority: HIGHEST for action port [ 1255.881895] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-169a4485-3dc4-41fd-9a06-2f0786d88690 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.882219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-169a4485-3dc4-41fd-9a06-2f0786d88690" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.882332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-169a4485-3dc4-41fd-9a06-2f0786d88690" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.882726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-169a4485-3dc4-41fd-9a06-2f0786d88690" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.882948] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('169a4485-3dc4-41fd-9a06-2f0786d88690',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.911748] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.911980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.911980] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.912215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.912331] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.912504] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.912646] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.912732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.912803] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.912875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.912994] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1255.939967] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.940222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.940222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.941093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.941093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.950301] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1256.080066] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.083491] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.083491] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.083491] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.083491] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.083491] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fe57526-4a38-4213-b086-d05377278315 is going to be updated. [ 1256.110143] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.111192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.113016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.113016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.113016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.121549] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fe57526-4a38-4213-b086-d05377278315 in Status: IN_PROGRESS for 2s [ 1256.361478] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.361666] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.361666] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.361929] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.362108] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.362270] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port b3aeeeb6-925c-4ec0-bb63-134b42cf98b5 not found, creating... [ 1256.362944] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.362944] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.362944] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.363216] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.363216] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.363683] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.363683] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.363819] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.363971] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.364126] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.364270] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: b3aeeeb6-925c-4ec0-bb63-134b42cf98b5 is going to be created. [ 1256.385476] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 169a4485-3dc4-41fd-9a06-2f0786d88690 [ 1256.385651] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.385787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.385857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.386088] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.386205] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.386287] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:169a4485-3dc4-41fd-9a06-2f0786d88690 already deleted. [ 1256.386368] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-169a4485-3dc4-41fd-9a06-2f0786d88690" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.387962] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.388068] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.388162] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.389375] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.389375] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.389375] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-b3aeeeb6-925c-4ec0-bb63-134b42cf98b5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.064079] env[69343]: INFO networking_nsxv3.common.synchronization [req-05d407fe-2958-4803-862a-19a4de6a8b60 req-118f17ee-f095-4957-8bd9-17f99ded62e6 service nova] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_rules [ 1257.064276] env[69343]: INFO networking_nsxv3.common.synchronization [req-05d407fe-2958-4803-862a-19a4de6a8b60 req-118f17ee-f095-4957-8bd9-17f99ded62e6 service nova] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1257.064419] env[69343]: INFO networking_nsxv3.common.synchronization [req-05d407fe-2958-4803-862a-19a4de6a8b60 req-118f17ee-f095-4957-8bd9-17f99ded62e6 service nova] Enqueued Resource ID: b3aeeeb6-925c-4ec0-bb63-134b42cf98b5 with Priority: HIGHEST for action port [ 1257.064651] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_rules [ 1257.064777] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1257.064872] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3aeeeb6-925c-4ec0-bb63-134b42cf98b5 with Priority: HIGHEST for action port [ 1257.065454] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.065583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.065654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.065850] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.065931] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.066872] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.067047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.067180] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3aeeeb6-925c-4ec0-bb63-134b42cf98b5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.067260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3aeeeb6-925c-4ec0-bb63-134b42cf98b5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.067360] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3aeeeb6-925c-4ec0-bb63-134b42cf98b5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.067487] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3aeeeb6-925c-4ec0-bb63-134b42cf98b5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.067574] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3aeeeb6-925c-4ec0-bb63-134b42cf98b5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.437081] env[69343]: INFO networking_nsxv3.common.synchronization [None req-d5d2d0eb-2815-4c9d-abe0-2ee00d9e3d48 None None] Enqueued Resource ID: 88700c70-ec67-423b-9672-09b4a4d300d8 with Priority: HIGHEST for action port [ 1257.437361] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88700c70-ec67-423b-9672-09b4a4d300d8 with Priority: HIGHEST for action port [ 1257.438014] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-88700c70-ec67-423b-9672-09b4a4d300d8 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.438148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88700c70-ec67-423b-9672-09b4a4d300d8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.438238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88700c70-ec67-423b-9672-09b4a4d300d8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.438498] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88700c70-ec67-423b-9672-09b4a4d300d8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.438582] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88700c70-ec67-423b-9672-09b4a4d300d8',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.571145] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.571292] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.571608] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3aeeeb6-925c-4ec0-bb63-134b42cf98b5 with status ACTIVE [ 1257.571707] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.571757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.571830] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.572052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.572146] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.572317] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.572414] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.572476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.576022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.576022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.576022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.576022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.576022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.576022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.576022] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.576022] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3aeeeb6-925c-4ec0-bb63-134b42cf98b5 is going to be updated. [ 1257.596807] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.596990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.596990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.597253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.597425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.597583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3aeeeb6-925c-4ec0-bb63-134b42cf98b5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.941635] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88700c70-ec67-423b-9672-09b4a4d300d8 [ 1257.941863] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.942007] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.942087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.942433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.942584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.942692] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88700c70-ec67-423b-9672-09b4a4d300d8 already deleted. [ 1257.942781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88700c70-ec67-423b-9672-09b4a4d300d8" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.959582] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1257.959745] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e deletion is rescheduled due to dependency. [ 1257.959856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.960014] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.960236] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.960421] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.960560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.960657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.960829] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.960914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.961022] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.130733] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fe57526-4a38-4213-b086-d05377278315 in Status: SUCCESS [ 1258.130942] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.463453] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.966201] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.327039] env[69343]: INFO networking_nsxv3.common.synchronization [None req-f9d35b1e-f972-45f5-9bd9-07149d198454 tempest-AttachVolumeShelveTestJSON-1111703815 tempest-AttachVolumeShelveTestJSON-1111703815-project-member] Enqueued Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGHEST for action security_group_rules [ 1259.327570] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGHEST for action security_group_rules [ 1259.327880] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.328014] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.328227] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.328496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.328585] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.400184] env[69343]: INFO networking_nsxv3.common.synchronization [None req-3ca940bc-d9e7-4965-be4d-ebf1850bc905 tempest-AttachVolumeShelveTestJSON-1111703815 tempest-AttachVolumeShelveTestJSON-1111703815-project-member] Enqueued Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGHEST for action security_group_rules [ 1259.400668] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGHEST for action security_group_rules [ 1259.400973] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.401080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.468683] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.469042] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.469042] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.469210] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.469210] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.469308] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1259.498497] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.498682] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.498739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.498908] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.499069] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.507508] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1259.848500] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.848674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.848674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.852226] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.852334] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.852439] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 already deleted. [ 1259.852528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.852687] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.852872] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.852966] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.375927] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.376247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.376364] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.376787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.376968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.377699] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 already deleted. [ 1260.377699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.663452] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.663834] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.663834] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.664067] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.664415] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.664615] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.664746] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.665037] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.665367] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.666492] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1260.666492] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1260.666492] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1260.666492] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1260.666492] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1260.666492] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1260.666492] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1260.686651] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1260.686931] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1260.687171] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1260.687395] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-547" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.687919] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-c881f573-c3d0-42ce-a18e-b14fbfe61362 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.688156] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-c881f573-c3d0-42ce-a18e-b14fbfe61362" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.688297] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-c881f573-c3d0-42ce-a18e-b14fbfe61362" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.688610] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-c881f573-c3d0-42ce-a18e-b14fbfe61362" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.688799] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c881f573-c3d0-42ce-a18e-b14fbfe61362',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.191748] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.192111] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.192111] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.192440] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.192627] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.192941] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.193147] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.193261] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.193466] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.193611] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.193896] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.194073] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.194190] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.194403] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.194567] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.194689] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: c881f573-c3d0-42ce-a18e-b14fbfe61362 is going to be updated. [ 1261.218970] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.219305] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.219447] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.220194] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.220469] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.220776] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-c881f573-c3d0-42ce-a18e-b14fbfe61362" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.516248] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1261.516634] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.516835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.517079] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.517285] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.517475] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.517552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.517729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.517818] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.517908] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.518010] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.017628] env[69343]: INFO networking_nsxv3.common.synchronization [req-c714d51b-d153-49d0-8c1c-1ceef6dfa466 req-e88737f6-45aa-4754-a60c-0cd1d7d5d9d3 service nova] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_rules [ 1262.017923] env[69343]: INFO networking_nsxv3.common.synchronization [req-c714d51b-d153-49d0-8c1c-1ceef6dfa466 req-e88737f6-45aa-4754-a60c-0cd1d7d5d9d3 service nova] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1262.018051] env[69343]: INFO networking_nsxv3.common.synchronization [req-c714d51b-d153-49d0-8c1c-1ceef6dfa466 req-e88737f6-45aa-4754-a60c-0cd1d7d5d9d3 service nova] Enqueued Resource ID: c881f573-c3d0-42ce-a18e-b14fbfe61362 with Priority: HIGHEST for action port [ 1262.018209] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_rules [ 1262.018342] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1262.018496] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c881f573-c3d0-42ce-a18e-b14fbfe61362 with Priority: HIGHEST for action port [ 1262.019254] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.019400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.019470] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.019674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.019756] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.021275] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.021404] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.021481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.021662] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.021830] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.021943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.022016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.022171] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.022255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.022348] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.023954] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-c881f573-c3d0-42ce-a18e-b14fbfe61362 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.024193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c881f573-c3d0-42ce-a18e-b14fbfe61362" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.024354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c881f573-c3d0-42ce-a18e-b14fbfe61362" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.024528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c881f573-c3d0-42ce-a18e-b14fbfe61362" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.024607] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c881f573-c3d0-42ce-a18e-b14fbfe61362',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.025823] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.025823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.025911] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.026057] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.026215] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.026313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.026376] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.026520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.026628] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.026875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.027081] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.027179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.027251] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.027400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.027545] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.027650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.027731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.027899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.028097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.028097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.028156] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.323996] env[69343]: INFO networking_nsxv3.common.synchronization [req-1da7e75e-7d31-43ba-aa35-e1ba32812986 req-303062e9-8f32-4485-8eac-d48c9db4539c tempest-ServerRescueTestJSON-142228568 tempest-ServerRescueTestJSON-142228568-project-member] Enqueued Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGHEST for action security_group_members [ 1262.324542] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGHEST for action security_group_members [ 1262.324885] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe57526-4a38-4213-b086-d05377278315 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.325055] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.325154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.325431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.325596] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.325699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.325768] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.325921] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.326018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.326108] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.522531] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.522744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.524069] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.526704] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c881f573-c3d0-42ce-a18e-b14fbfe61362 with status ACTIVE [ 1262.526896] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.527030] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.527101] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.527425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.527425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.527607] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.527702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.527772] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.528522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.528522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.528522] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.528522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.528522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.528522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.528522] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.528858] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c881f573-c3d0-42ce-a18e-b14fbfe61362 is going to be updated. [ 1262.530077] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c336180-c6d8-473b-8306-38646bd8e00e: rpc.has_security_group_logging(os_id): False [ 1262.549254] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.549458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.549458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.549658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.549846] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.549925] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.550038] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.550102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.550253] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.550331] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.550532] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.550629] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.550690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.550832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.550898] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.551085] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.551179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.551301] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.551384] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.551458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.551544] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1262.563945] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.564133] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.564176] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.564365] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.564504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.564659] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c881f573-c3d0-42ce-a18e-b14fbfe61362" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.639614] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.639837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.639837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.640045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.640195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.673275] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1262.828316] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.828503] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.828543] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.828779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.828879] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.829104] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.829206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.829275] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.829418] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.829499] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.829588] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fe57526-4a38-4213-b086-d05377278315 is going to be updated. [ 1262.866765] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.866931] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.866973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.867210] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.867486] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.877064] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fe57526-4a38-4213-b086-d05377278315 in Status: IN_PROGRESS for 2s [ 1263.027092] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.529262] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.529445] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.529503] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.529699] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.529787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.529886] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be updated. [ 1263.542094] env[69343]: INFO networking_nsxv3.common.synchronization [req-e09e8206-e854-49d9-bad2-81dfc4c96061 req-d4cd0564-1aa1-47e2-95ed-dfcd0ea0dcb4 tempest-ServersNegativeTestMultiTenantJSON-326882518 tempest-ServersNegativeTestMultiTenantJSON-326882518-project-member] Enqueued Resource ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 with Priority: HIGHEST for action security_group_members [ 1263.542630] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 with Priority: HIGHEST for action security_group_members [ 1263.542939] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a21b9c03-f940-48a9-8410-3b091dc5faa5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.543078] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.543191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.543444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.543606] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.543711] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.543778] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.543918] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.544018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.544120] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a21b9c03-f940-48a9-8410-3b091dc5faa5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.559534] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.559692] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.559737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.559932] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.560086] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.569076] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: IN_PROGRESS for 2s [ 1263.834589] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.834786] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-668" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.834911] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-668" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.835332] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-668" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.835720] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.835959] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.836111] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.836380] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.836548] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.836799] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1263.837694] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1263.837694] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1263.837694] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1263.837694] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1263.837694] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1263.837694] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1263.865654] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1263.865807] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1263.865959] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1263.866169] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-668" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.867019] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-51d16880-fb24-4079-a854-88860081e6c6 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.867019] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-51d16880-fb24-4079-a854-88860081e6c6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.867019] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-51d16880-fb24-4079-a854-88860081e6c6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.867347] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-51d16880-fb24-4079-a854-88860081e6c6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.867497] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51d16880-fb24-4079-a854-88860081e6c6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.047168] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.047168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.047168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.047168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.047168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.047609] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.047609] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.047609] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.047737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.047737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.047822] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 already deleted. [ 1264.047882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.370593] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.370780] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.370911] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.371335] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.371501] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.371686] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 51d16880-fb24-4079-a854-88860081e6c6 not found, creating... [ 1264.371985] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.372174] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.372300] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.372538] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.372682] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.372972] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.373149] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.373436] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.373798] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.374084] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.374340] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 51d16880-fb24-4079-a854-88860081e6c6 is going to be created. [ 1264.396954] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.397176] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.397300] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.397598] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.397933] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.398192] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-51d16880-fb24-4079-a854-88860081e6c6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.689650] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1264.689650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.887976] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fe57526-4a38-4213-b086-d05377278315 in Status: SUCCESS [ 1264.888229] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fe57526-4a38-4213-b086-d05377278315 deletion is rescheduled due to dependency. [ 1264.888425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.236089] env[69343]: INFO networking_nsxv3.common.synchronization [req-e09e8206-e854-49d9-bad2-81dfc4c96061 req-4e2f040c-6919-4226-97bb-35dd0937047f service nova] Enqueued Resource ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 with Priority: HIGHEST for action security_group_rules [ 1265.236405] env[69343]: INFO networking_nsxv3.common.synchronization [req-e09e8206-e854-49d9-bad2-81dfc4c96061 req-4e2f040c-6919-4226-97bb-35dd0937047f service nova] Enqueued Resource ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 with Priority: HIGHEST for action security_group_members [ 1265.236405] env[69343]: INFO networking_nsxv3.common.synchronization [req-e09e8206-e854-49d9-bad2-81dfc4c96061 req-4e2f040c-6919-4226-97bb-35dd0937047f service nova] Enqueued Resource ID: 51d16880-fb24-4079-a854-88860081e6c6 with Priority: HIGHEST for action port [ 1265.236672] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 with Priority: HIGHEST for action security_group_rules [ 1265.236802] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 with Priority: HIGHEST for action security_group_members [ 1265.236899] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d16880-fb24-4079-a854-88860081e6c6 with Priority: HIGHEST for action port [ 1265.237498] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a21b9c03-f940-48a9-8410-3b091dc5faa5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.237650] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.237745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.238009] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.238106] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a21b9c03-f940-48a9-8410-3b091dc5faa5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.238972] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a21b9c03-f940-48a9-8410-3b091dc5faa5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.239097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.239215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.239380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.239540] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.239622] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.239695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.239823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.239934] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.240083] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a21b9c03-f940-48a9-8410-3b091dc5faa5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.240884] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-51d16880-fb24-4079-a854-88860081e6c6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.241267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51d16880-fb24-4079-a854-88860081e6c6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.241267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51d16880-fb24-4079-a854-88860081e6c6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.241267] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51d16880-fb24-4079-a854-88860081e6c6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.241267] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51d16880-fb24-4079-a854-88860081e6c6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.579921] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1265.580359] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.580575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.580857] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.581065] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.581218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.581318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.581491] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.582375] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.582375] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.582375] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.743515] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a21b9c03-f940-48a9-8410-3b091dc5faa5 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.745728] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.745956] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51d16880-fb24-4079-a854-88860081e6c6 with status ACTIVE [ 1265.746161] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.746343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.746439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.746674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.746767] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.746946] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.747058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.747122] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.747284] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.747365] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.747543] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.747654] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.747722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.747864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.747938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.748037] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51d16880-fb24-4079-a854-88860081e6c6 is going to be updated. [ 1265.749784] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a21b9c03-f940-48a9-8410-3b091dc5faa5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.771458] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.771713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.771713] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.771863] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.772014] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.772186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51d16880-fb24-4079-a854-88860081e6c6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.083682] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.083848] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.083935] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.084149] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.084325] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.084434] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.084485] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.084642] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.084730] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.084817] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.084963] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.085071] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.085133] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.085290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.085492] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.085589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.085651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.085789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.085867] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.085951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.086051] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.201981] env[69343]: INFO networking_nsxv3.common.synchronization [req-5c82b8fb-fd21-4469-8be0-ecbbd2b12855 req-0b59dec4-9288-4dbb-b626-9dfcdf18d212 tempest-AttachVolumeShelveTestJSON-1111703815 tempest-AttachVolumeShelveTestJSON-1111703815-project-member] Enqueued Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGHEST for action security_group_members [ 1266.202609] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGHEST for action security_group_members [ 1266.202970] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2fa593e-feb7-41a5-abd8-e3bf366056f7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.203507] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.203574] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.203910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.204107] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.204215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.204278] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.204450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.204527] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.204623] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.252029] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a21b9c03-f940-48a9-8410-3b091dc5faa5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.630287] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e6e2d6-f175-4be9-be9a-bdb1208e0e04: rpc.has_security_group_logging(os_id): False [ 1266.658844] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.659010] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.659094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.659313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.659412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.659632] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.659740] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.659789] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.659937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.660028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.660213] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.660308] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.660374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.660513] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.660586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.660762] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.660853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.660914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.661232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.661352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.661472] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be updated. [ 1266.706519] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.706693] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.706731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.707011] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.707104] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.707358] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.707467] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.707535] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.707707] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.707778] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.707863] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 already deleted. [ 1266.707945] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.727103] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.727290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.727290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.727501] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.727739] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.741643] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: IN_PROGRESS for 2s [ 1266.755454] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.755627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.755697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.755903] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.756028] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.756160] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 is going to be created. [ 1266.769328] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.769524] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-656" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.769666] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-656" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.769944] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-656" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.770211] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.770395] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.770547] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.770779] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.770933] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.771161] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1266.771279] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1266.771391] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1266.771502] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1266.771614] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1266.771722] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1266.771857] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1266.780106] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.780286] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.780385] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.780488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.780644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.793212] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 in Status: UNINITIALIZED for 2s [ 1266.801645] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1266.801819] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1266.801966] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1266.802166] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-656" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.802500] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-05142183-51ba-4d8b-b2a3-46be8a85d1fd taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.802723] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-05142183-51ba-4d8b-b2a3-46be8a85d1fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.802860] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-05142183-51ba-4d8b-b2a3-46be8a85d1fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.803206] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-05142183-51ba-4d8b-b2a3-46be8a85d1fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.803389] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05142183-51ba-4d8b-b2a3-46be8a85d1fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.306315] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.306702] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.306912] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.307390] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.307713] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.307982] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 05142183-51ba-4d8b-b2a3-46be8a85d1fd not found, creating... [ 1267.308471] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.308757] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.308989] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.309392] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.309671] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.310187] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.310469] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.310697] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.311083] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.311350] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.311610] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 05142183-51ba-4d8b-b2a3-46be8a85d1fd is going to be created. [ 1267.336261] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.336627] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.337016] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.337463] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.337850] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.338241] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-05142183-51ba-4d8b-b2a3-46be8a85d1fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.009398] env[69343]: INFO networking_nsxv3.common.synchronization [req-5c82b8fb-fd21-4469-8be0-ecbbd2b12855 req-be6d44a9-9261-472c-a1ee-d4a914797398 service nova] Enqueued Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGHEST for action security_group_rules [ 1268.009398] env[69343]: INFO networking_nsxv3.common.synchronization [req-5c82b8fb-fd21-4469-8be0-ecbbd2b12855 req-be6d44a9-9261-472c-a1ee-d4a914797398 service nova] Enqueued Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGHEST for action security_group_members [ 1268.009398] env[69343]: INFO networking_nsxv3.common.synchronization [req-5c82b8fb-fd21-4469-8be0-ecbbd2b12855 req-be6d44a9-9261-472c-a1ee-d4a914797398 service nova] Enqueued Resource ID: 05142183-51ba-4d8b-b2a3-46be8a85d1fd with Priority: HIGHEST for action port [ 1268.009398] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGHEST for action security_group_rules [ 1268.009398] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGHEST for action security_group_members [ 1268.009398] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05142183-51ba-4d8b-b2a3-46be8a85d1fd with Priority: HIGHEST for action port [ 1268.009398] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.009398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.009398] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.009979] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.011079] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.011791] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2fa593e-feb7-41a5-abd8-e3bf366056f7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.012109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.015018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.015018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.015018] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.015018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.015018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.015018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.015018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.015018] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.015018] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-05142183-51ba-4d8b-b2a3-46be8a85d1fd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.015018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05142183-51ba-4d8b-b2a3-46be8a85d1fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.015018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05142183-51ba-4d8b-b2a3-46be8a85d1fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.015018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05142183-51ba-4d8b-b2a3-46be8a85d1fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.015018] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05142183-51ba-4d8b-b2a3-46be8a85d1fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.513459] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2fa593e-feb7-41a5-abd8-e3bf366056f7 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.514124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.517215] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.518791] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05142183-51ba-4d8b-b2a3-46be8a85d1fd with status ACTIVE [ 1268.519040] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.519173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.519246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.519472] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.519972] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.519972] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.519972] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.519972] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.520225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.520225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.520315] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.520415] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.520520] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.520671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.520703] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.520997] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05142183-51ba-4d8b-b2a3-46be8a85d1fd is going to be updated. [ 1268.547064] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.547903] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.547903] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.547903] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.547903] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.547903] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05142183-51ba-4d8b-b2a3-46be8a85d1fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.767149] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1268.767373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.806977] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 in Status: SUCCESS [ 1268.807202] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.807370] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.807612] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.807814] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.807933] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.808010] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.808172] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.808257] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.808345] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.808442] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a21b9c03-f940-48a9-8410-3b091dc5faa5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.994184] env[69343]: INFO networking_nsxv3.common.synchronization [req-c6f03b0a-9561-4af4-b884-6e86a816328a req-edd7a4ac-c924-4d3d-920e-0ed80066efdd tempest-DeleteServersTestJSON-1417757124 tempest-DeleteServersTestJSON-1417757124-project-member] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1268.994732] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1268.995049] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.995180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.995246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.995504] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.995672] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.995765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.995834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.995986] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.996085] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.996176] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.023541] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.312875] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a21b9c03-f940-48a9-8410-3b091dc5faa5 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.313151] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.313256] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.313507] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.313751] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.313907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.314021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.314282] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.314348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.314440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.314595] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a21b9c03-f940-48a9-8410-3b091dc5faa5 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.314691] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.314746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.314892] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.315046] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.315141] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.315201] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.315374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.315476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.315566] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.315620] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a21b9c03-f940-48a9-8410-3b091dc5faa5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.498209] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.498493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.498822] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.499243] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.499464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.499827] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.500134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.500246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.500412] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.500501] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.500606] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1269.525693] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.526113] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.526113] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.526192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.526236] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.526359] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 is going to be created. [ 1269.533312] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.533511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.533558] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.533755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.533899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.542315] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1269.552103] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.552103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.552103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.552586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.552586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.563240] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 in Status: UNINITIALIZED for 2s [ 1269.818074] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a21b9c03-f940-48a9-8410-3b091dc5faa5: rpc.has_security_group_logging(os_id): False [ 1269.835845] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.836061] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.836061] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.836271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.836425] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.836568] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.836670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.836740] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.836917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.836999] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.837197] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.837294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.837355] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.837515] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.837604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.837813] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.837912] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.837970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.838121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.838196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.838280] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 is going to be created. [ 1269.897159] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.897159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.897442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.897442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.897627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.908429] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 in Status: IN_PROGRESS for 2s [ 1271.554074] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1271.554074] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e deletion is rescheduled due to dependency. [ 1271.554074] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.573289] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 in Status: SUCCESS [ 1271.573587] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.573844] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.574180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.574465] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.574651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.574755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.574989] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.575137] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.575272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.575428] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.920926] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 in Status: SUCCESS [ 1271.920926] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.078455] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.581120] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2fa593e-feb7-41a5-abd8-e3bf366056f7: rpc.has_security_group_logging(os_id): False [ 1272.601257] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.601411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.601471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.601697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.601780] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.602071] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.602186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.602247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.602399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.602484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.602575] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 is going to be created. [ 1272.660076] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.660238] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.660283] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.660505] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.660690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.672917] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 in Status: IN_PROGRESS for 2s [ 1273.996216] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1273.996570] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1274.685449] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 in Status: SUCCESS [ 1274.685697] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.082919] env[69343]: INFO networking_nsxv3.common.synchronization [req-fb261c71-8a24-4958-8c41-02bd113a9afd req-34290105-61ed-46a5-880f-728db0400073 tempest-ServersNegativeTestMultiTenantJSON-326882518 tempest-ServersNegativeTestMultiTenantJSON-326882518-project-member] Enqueued Resource ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 with Priority: HIGHEST for action security_group_members [ 1276.083458] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 with Priority: HIGHEST for action security_group_members [ 1276.083766] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-a21b9c03-f940-48a9-8410-3b091dc5faa5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.083919] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.083993] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.084210] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.084380] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.084484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.084678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.084744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.084790] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.084860] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a21b9c03-f940-48a9-8410-3b091dc5faa5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.587522] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.587731] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.587815] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.588079] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.588179] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.588480] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.588557] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.588619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.588737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.588820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.588908] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 is going to be updated. [ 1276.642604] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.642604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.642785] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.642850] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.642991] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.652189] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 in Status: IN_PROGRESS for 2s [ 1278.066223] env[69343]: INFO networking_nsxv3.common.synchronization [req-10d51700-c4f6-44aa-bd3e-7f7778f63196 req-02e7f1b7-7bb4-4bc1-90b7-e3da85ab0137 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_members [ 1278.066223] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_members [ 1278.066223] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.066579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.066579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.066579] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.066709] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.066806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.066874] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.066998] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.067093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.067225] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.480853] env[69343]: INFO networking_nsxv3.common.synchronization [req-e2d4bd9f-1db5-4222-995e-b3e65f581f56 req-07d5f210-91e6-49e6-9117-c82ab0c3dfa2 tempest-DeleteServersTestJSON-1417757124 tempest-DeleteServersTestJSON-1417757124-project-member] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1278.480853] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1278.480853] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.480853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.480853] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.482534] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.482860] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.486375] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.486375] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.486492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.486571] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.486672] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.569055] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.670683] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 in Status: SUCCESS [ 1278.670923] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a21b9c03-f940-48a9-8410-3b091dc5faa5 deletion is rescheduled due to dependency. [ 1278.671068] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a21b9c03-f940-48a9-8410-3b091dc5faa5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.770511] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-284 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.770758] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.770900] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.771205] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.771486] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.771653] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.771787] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.772024] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.772180] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.772396] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1278.772516] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1278.772634] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1278.772749] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1278.772866] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1278.772976] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1278.773126] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1278.793154] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1278.793324] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1278.793500] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1278.793822] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-284" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.794182] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-8b191972-30a8-4aac-8e68-00a77b5508f5 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.794366] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-8b191972-30a8-4aac-8e68-00a77b5508f5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.794491] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-8b191972-30a8-4aac-8e68-00a77b5508f5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.794874] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-8b191972-30a8-4aac-8e68-00a77b5508f5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.795062] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b191972-30a8-4aac-8e68-00a77b5508f5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.989047] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.989218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.989292] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.989512] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.989623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.989841] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.989943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.990016] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.990181] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.990277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.990345] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1279.023178] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.023324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.023397] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.023610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.023754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.036210] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1279.071460] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.297534] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.297863] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.297944] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.298248] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.298409] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.298569] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 8b191972-30a8-4aac-8e68-00a77b5508f5 not found, creating... [ 1279.298839] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.299009] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.299137] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.299362] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.299619] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.299795] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.300049] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.300137] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.300292] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.300430] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.300572] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 8b191972-30a8-4aac-8e68-00a77b5508f5 is going to be created. [ 1279.321716] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.321958] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.322022] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.322298] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.322563] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.322794] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-8b191972-30a8-4aac-8e68-00a77b5508f5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.573618] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.573838] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.573838] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.574083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.574216] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.574263] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 is going to be updated. [ 1279.603603] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.603833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.603833] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.604046] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.604193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.613118] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 in Status: IN_PROGRESS for 2s [ 1280.031250] env[69343]: INFO networking_nsxv3.common.synchronization [req-e2d4bd9f-1db5-4222-995e-b3e65f581f56 req-25687ff4-e0cc-462d-8ddd-2867eee7dc23 service nova] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_rules [ 1280.031432] env[69343]: INFO networking_nsxv3.common.synchronization [req-e2d4bd9f-1db5-4222-995e-b3e65f581f56 req-25687ff4-e0cc-462d-8ddd-2867eee7dc23 service nova] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1280.031582] env[69343]: INFO networking_nsxv3.common.synchronization [req-e2d4bd9f-1db5-4222-995e-b3e65f581f56 req-25687ff4-e0cc-462d-8ddd-2867eee7dc23 service nova] Enqueued Resource ID: 8b191972-30a8-4aac-8e68-00a77b5508f5 with Priority: HIGHEST for action port [ 1280.031817] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_rules [ 1280.031944] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1280.032053] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b191972-30a8-4aac-8e68-00a77b5508f5 with Priority: HIGHEST for action port [ 1280.032588] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.032706] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.032800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.032966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.033057] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.034275] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.034386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.034588] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b191972-30a8-4aac-8e68-00a77b5508f5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.034691] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b191972-30a8-4aac-8e68-00a77b5508f5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.034755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b191972-30a8-4aac-8e68-00a77b5508f5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.034922] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b191972-30a8-4aac-8e68-00a77b5508f5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.035032] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b191972-30a8-4aac-8e68-00a77b5508f5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.536952] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.537337] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.537337] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b191972-30a8-4aac-8e68-00a77b5508f5 with status ACTIVE [ 1280.537470] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.537586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.537653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.537862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.537952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.538141] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.538275] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.538333] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.538454] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.538536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.538715] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.538809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.538870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.539015] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.539095] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.539179] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b191972-30a8-4aac-8e68-00a77b5508f5 is going to be updated. [ 1280.559590] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.559753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.559798] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.560031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.560143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.560299] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b191972-30a8-4aac-8e68-00a77b5508f5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.045401] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1281.045647] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e deletion is rescheduled due to dependency. [ 1281.045726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.045864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.046093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.046279] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.046396] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.046475] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.046665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.046754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.046851] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.549456] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.624020] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 in Status: SUCCESS [ 1281.624268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.051970] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.555207] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.555531] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.555531] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.555742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.555841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.555954] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1282.584945] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.585134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.585180] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.585375] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.585585] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.596124] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1284.277524] env[69343]: INFO networking_nsxv3.common.synchronization [req-0558af2d-cc29-4150-8511-6efa5f2cd4b6 req-030bb62f-3817-4459-b2ff-73eeda5d9919 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_members [ 1284.278171] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGHEST for action security_group_members [ 1284.278880] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.278880] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.278880] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.278880] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.279139] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.279139] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.279222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.279305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.279391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.279482] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.606139] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1284.606372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.606549] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.606770] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.606965] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.607102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.607168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.607329] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.607414] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.607536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.607680] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.782041] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.782293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.782293] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.782501] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.782596] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.782795] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.782905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.782975] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.783146] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.783225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.783319] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 is going to be updated. [ 1284.809898] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.810213] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.810213] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.810373] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.810451] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.819395] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 in Status: IN_PROGRESS for 2s [ 1285.110559] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.110791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.110791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.110924] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.111099] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.111206] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.111273] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.111442] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.111508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.111599] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.111749] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.111842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.111904] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.112058] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.112196] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.112287] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.112348] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.112484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.112561] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.112644] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.112731] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.615245] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c336180-c6d8-473b-8306-38646bd8e00e: rpc.has_security_group_logging(os_id): False [ 1285.636024] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.636284] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.636284] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.636606] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.636606] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.636840] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.636940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.637049] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.637218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.637298] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.637504] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.637604] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.637690] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.637800] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.637905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.638099] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.638199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.638259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.638402] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.638478] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.638565] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1285.707675] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.707899] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.708044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.708192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.708343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.723193] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1286.197820] env[69343]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1286.198028] env[69343]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1286.831294] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 in Status: SUCCESS [ 1286.831659] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 deletion is rescheduled due to dependency. [ 1286.831701] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.737327] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1287.737517] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.723455] env[69343]: INFO networking_nsxv3.common.synchronization [None req-08ed1182-bf80-4c0a-b0d9-6a5ad0c4e476 tempest-AttachInterfacesTestJSON-1521844874 tempest-AttachInterfacesTestJSON-1521844874-project-member] Enqueued Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1288.724196] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 with Priority: HIGHEST for action security_group_members [ 1288.724395] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.725052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.725052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.725052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.725052] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.725052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.725391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.725391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.725391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.725391] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e6e2d6-f175-4be9-be9a-bdb1208e0e04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.229354] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.229580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.229580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.229947] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.229947] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.230124] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.230237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.230298] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.230458] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.230528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.230618] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 is going to be updated. [ 1289.259802] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.259973] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.260062] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.260244] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.260388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.268938] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: IN_PROGRESS for 2s [ 1291.281412] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 in Status: SUCCESS [ 1291.281679] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e6e2d6-f175-4be9-be9a-bdb1208e0e04 deletion is rescheduled due to dependency. [ 1291.281750] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e6e2d6-f175-4be9-be9a-bdb1208e0e04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.725303] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1293.725693] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1298.726149] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1298.726520] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1300.462673] env[69343]: INFO networking_nsxv3.common.synchronization [req-d2d319e8-e83e-4de1-b226-ffaa4525d543 req-9b99e662-2916-42c2-901a-ebb3965b6e4e tempest-ServerActionsTestJSON-1397784852 tempest-ServerActionsTestJSON-1397784852-project-member] Enqueued Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 1300.463032] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGHEST for action security_group_members [ 1300.463348] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.463497] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.463583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.463790] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.463947] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.464052] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.464112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.464349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.464474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.464596] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.966942] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.967194] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.967358] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.967651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.967757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.967978] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.968094] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.968165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.968312] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.968388] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.968468] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 is going to be updated. [ 1301.000771] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.000996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.000996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.001196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.001338] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.009496] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: IN_PROGRESS for 2s [ 1303.020403] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ceec863-0a7a-401b-a8e8-048823180971 in Status: SUCCESS [ 1303.020756] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 deletion is rescheduled due to dependency. [ 1303.020756] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.464548] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1305.465095] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1308.348380] env[69343]: INFO networking_nsxv3.common.synchronization [None req-eac7f3b7-f12f-4dde-bafb-77b2189d6469 None None] Enqueued Resource ID: dfbb0421-0707-4bbe-83fc-c1fd6834ac7d with Priority: HIGHEST for action port [ 1308.348621] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbb0421-0707-4bbe-83fc-c1fd6834ac7d with Priority: HIGHEST for action port [ 1308.349593] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfbb0421-0707-4bbe-83fc-c1fd6834ac7d taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.349824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfbb0421-0707-4bbe-83fc-c1fd6834ac7d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.349824] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfbb0421-0707-4bbe-83fc-c1fd6834ac7d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.350189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfbb0421-0707-4bbe-83fc-c1fd6834ac7d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.350291] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfbb0421-0707-4bbe-83fc-c1fd6834ac7d',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.854986] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfbb0421-0707-4bbe-83fc-c1fd6834ac7d [ 1308.855725] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.855725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.855725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.856092] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.856863] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.857017] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfbb0421-0707-4bbe-83fc-c1fd6834ac7d already deleted. [ 1308.857121] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfbb0421-0707-4bbe-83fc-c1fd6834ac7d" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.227392] env[69343]: INFO networking_nsxv3.common.synchronization [None req-167839b0-c89f-4324-aec4-5db4e1e139ec None None] Enqueued Resource ID: 67821a4f-bd5e-41ab-adf7-32dfb1cfd42e with Priority: HIGHEST for action port [ 1310.227695] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67821a4f-bd5e-41ab-adf7-32dfb1cfd42e with Priority: HIGHEST for action port [ 1310.228281] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-67821a4f-bd5e-41ab-adf7-32dfb1cfd42e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.228423] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67821a4f-bd5e-41ab-adf7-32dfb1cfd42e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.228488] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67821a4f-bd5e-41ab-adf7-32dfb1cfd42e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.228722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67821a4f-bd5e-41ab-adf7-32dfb1cfd42e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.228808] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67821a4f-bd5e-41ab-adf7-32dfb1cfd42e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.730962] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67821a4f-bd5e-41ab-adf7-32dfb1cfd42e [ 1310.731249] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.731386] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.731459] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.731670] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.731762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.731857] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67821a4f-bd5e-41ab-adf7-32dfb1cfd42e already deleted. [ 1310.731940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67821a4f-bd5e-41ab-adf7-32dfb1cfd42e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.317092] env[69343]: INFO networking_nsxv3.common.synchronization [req-feb666b0-f5d6-4644-b126-e9af37aa6ec4 req-ddc9b250-6b9a-431a-927d-ec60d017f2ea tempest-ServerAddressesNegativeTestJSON-46674405 tempest-ServerAddressesNegativeTestJSON-46674405-project-member] Enqueued Resource ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 with Priority: HIGHEST for action security_group_members [ 1313.317568] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 with Priority: HIGHEST for action security_group_members [ 1313.317870] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3858135f-36a9-49b7-8e06-7f64944b17c1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.317996] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.318072] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.318322] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.318485] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.318585] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.318647] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.318797] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.318884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.318979] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3858135f-36a9-49b7-8e06-7f64944b17c1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.574789] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-214 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.575062] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-214" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.575255] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-214" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.575560] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-214" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.575880] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.576254] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.576254] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.578151] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.578151] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.578151] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1313.578151] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1313.578151] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1313.578151] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1313.578151] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1313.578151] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1313.578151] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1313.599737] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1313.599927] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1313.600086] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1313.600267] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-214" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.600584] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-c8c30b2d-3474-43be-a320-aaeef5a4a628 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.600762] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-c8c30b2d-3474-43be-a320-aaeef5a4a628" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.601117] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-c8c30b2d-3474-43be-a320-aaeef5a4a628" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.601454] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-c8c30b2d-3474-43be-a320-aaeef5a4a628" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.601851] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8c30b2d-3474-43be-a320-aaeef5a4a628',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.821819] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.821977] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.822087] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.822283] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.822374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.822580] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.822686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.822748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.822890] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.822968] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.823072] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 already deleted. [ 1313.823156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.104357] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.104510] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.104730] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.104961] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.105161] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.105646] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port c8c30b2d-3474-43be-a320-aaeef5a4a628 not found, creating... [ 1314.105646] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.105849] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.105949] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.106196] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.106327] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.106641] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.106807] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.106922] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.107176] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.107308] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.107425] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: c8c30b2d-3474-43be-a320-aaeef5a4a628 is going to be created. [ 1314.129971] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.129971] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.129971] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.130242] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.130528] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.130812] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-c8c30b2d-3474-43be-a320-aaeef5a4a628" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.077555] env[69343]: INFO networking_nsxv3.common.synchronization [req-feb666b0-f5d6-4644-b126-e9af37aa6ec4 req-a313d503-9c3d-4745-82e2-b739662358fa service nova] Enqueued Resource ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 with Priority: HIGHEST for action security_group_rules [ 1315.077796] env[69343]: INFO networking_nsxv3.common.synchronization [req-feb666b0-f5d6-4644-b126-e9af37aa6ec4 req-a313d503-9c3d-4745-82e2-b739662358fa service nova] Enqueued Resource ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 with Priority: HIGHEST for action security_group_members [ 1315.078062] env[69343]: INFO networking_nsxv3.common.synchronization [req-feb666b0-f5d6-4644-b126-e9af37aa6ec4 req-a313d503-9c3d-4745-82e2-b739662358fa service nova] Enqueued Resource ID: c8c30b2d-3474-43be-a320-aaeef5a4a628 with Priority: HIGHEST for action port [ 1315.078589] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 with Priority: HIGHEST for action security_group_rules [ 1315.078732] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 with Priority: HIGHEST for action security_group_members [ 1315.078854] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8c30b2d-3474-43be-a320-aaeef5a4a628 with Priority: HIGHEST for action port [ 1315.079188] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3858135f-36a9-49b7-8e06-7f64944b17c1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.079317] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.079419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.079762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.079893] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3858135f-36a9-49b7-8e06-7f64944b17c1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.080746] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3858135f-36a9-49b7-8e06-7f64944b17c1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.080859] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.080928] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.081117] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.081261] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.081352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.081416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.081581] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.081673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.081762] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3858135f-36a9-49b7-8e06-7f64944b17c1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.083820] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8c30b2d-3474-43be-a320-aaeef5a4a628 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.083820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8c30b2d-3474-43be-a320-aaeef5a4a628" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.083820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8c30b2d-3474-43be-a320-aaeef5a4a628" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.083820] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8c30b2d-3474-43be-a320-aaeef5a4a628" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.083820] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8c30b2d-3474-43be-a320-aaeef5a4a628',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.584047] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3858135f-36a9-49b7-8e06-7f64944b17c1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.585573] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3858135f-36a9-49b7-8e06-7f64944b17c1 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.585692] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.587571] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8c30b2d-3474-43be-a320-aaeef5a4a628 with status ACTIVE [ 1315.587753] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.587874] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.587946] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.588167] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.588256] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.588429] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.588545] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.588586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.588736] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.588808] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.588986] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.589091] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.589144] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.589285] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.589359] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.589442] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8c30b2d-3474-43be-a320-aaeef5a4a628 is going to be updated. [ 1315.610395] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.610614] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.610614] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.610793] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.610933] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.611114] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8c30b2d-3474-43be-a320-aaeef5a4a628" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.087290] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3858135f-36a9-49b7-8e06-7f64944b17c1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.589998] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.590196] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.590276] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.590494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.590623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.590753] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 is going to be created. [ 1316.612914] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.613077] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.613151] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.613365] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.613605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.623239] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 in Status: UNINITIALIZED for 2s [ 1318.633062] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 in Status: SUCCESS [ 1318.633421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.633421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.633618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.633817] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.633930] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.633986] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.634148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.634232] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.634321] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.634413] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3858135f-36a9-49b7-8e06-7f64944b17c1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.136751] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3858135f-36a9-49b7-8e06-7f64944b17c1 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.137065] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.137065] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.137240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.137421] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.137530] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.137594] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.137756] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.137850] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.137952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.138142] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3858135f-36a9-49b7-8e06-7f64944b17c1 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.138271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.138323] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.138464] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.138605] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.138695] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.138759] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.138913] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.139073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.139073] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.139180] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3858135f-36a9-49b7-8e06-7f64944b17c1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.162548] env[69343]: INFO networking_nsxv3.common.synchronization [req-476cc413-bc72-452d-b071-2d0cf1404c6f req-8d56a44f-9348-4e2c-b70c-60c52b59e1bc tempest-DeleteServersTestJSON-1417757124 tempest-DeleteServersTestJSON-1417757124-project-member] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1319.163104] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGHEST for action security_group_members [ 1319.163559] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.163559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.163671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.163794] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.164151] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.164333] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.164421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.164671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.164771] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.164886] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.641169] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3858135f-36a9-49b7-8e06-7f64944b17c1: rpc.has_security_group_logging(os_id): False [ 1319.660380] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.660673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.660673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.660842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.660934] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.661161] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.661269] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.661340] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.661481] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.661559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.661745] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.661839] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.661909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.662090] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.662171] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.662365] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.662473] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.662528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.662636] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.662700] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.662791] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 is going to be created. [ 1319.667555] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.667705] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.667766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.667872] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.667952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.668145] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.668237] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.668300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.668435] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.668511] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.668595] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be updated. [ 1319.723908] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.724134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.724134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.724344] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.724529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.735689] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 in Status: IN_PROGRESS for 2s [ 1320.546341] env[69343]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function PUT Argumetns {'path': '/policy/api/v1/infra/domains/default/groups/5c336180-c6d8-473b-8306-38646bd8e00e', 'data': {'id': '5c336180-c6d8-473b-8306-38646bd8e00e', 'display_name': '5c336180-c6d8-473b-8306-38646bd8e00e', 'path': '/infra/domains/default/groups/5c336180-c6d8-473b-8306-38646bd8e00e', 'expression': [{'value': 'security_group|5c336180-c6d8-473b-8306-38646bd8e00e', 'member_type': 'SegmentPort', 'key': 'Tag', 'operator': 'EQUALS', 'resource_type': 'Condition'}], 'tags': [{'scope': 'age', 'tag': 1747229491}, {'scope': 'revision_number', 'tag': None}], '_revision': 15}} Response=('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')): requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [ 1320.546606] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Retrying connection (1/2) with timeout 2s for Client.put {{(pid=69343) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:122}} [ 1321.754634] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 in Status: SUCCESS [ 1321.754981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.573382] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.573594] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.573594] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.573836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.575241] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.583256] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: IN_PROGRESS for 2s [ 1324.164407] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1324.164796] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1324.596237] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c336180-c6d8-473b-8306-38646bd8e00e in Status: SUCCESS [ 1324.597051] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e deletion is rescheduled due to dependency. [ 1324.597051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.974257] env[69343]: INFO networking_nsxv3.common.synchronization [req-1c355091-bf83-4b9d-9f6e-866b7f7d692d req-24444b42-b05f-46f6-88e3-3c6a1a69aed7 tempest-ServerAddressesNegativeTestJSON-46674405 tempest-ServerAddressesNegativeTestJSON-46674405-project-member] Enqueued Resource ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 with Priority: HIGHEST for action security_group_members [ 1325.974257] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 with Priority: HIGHEST for action security_group_members [ 1325.974867] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-3858135f-36a9-49b7-8e06-7f64944b17c1 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.975167] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.975357] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.975651] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.975930] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.977564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.977564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.977564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.977564] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.977564] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3858135f-36a9-49b7-8e06-7f64944b17c1',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.479143] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.479143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.479439] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.479476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.479618] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.479911] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.480054] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.480154] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.480416] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.480518] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.480635] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 is going to be updated. [ 1326.521351] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.521597] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.521657] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.521951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.522133] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.532271] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 in Status: IN_PROGRESS for 2s [ 1328.543799] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 in Status: SUCCESS [ 1328.544282] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3858135f-36a9-49b7-8e06-7f64944b17c1 deletion is rescheduled due to dependency. [ 1328.544282] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3858135f-36a9-49b7-8e06-7f64944b17c1" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.974902] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.975258] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1334.023238] env[69343]: INFO networking_nsxv3.common.synchronization [None req-9c23c2ce-16c3-498d-833e-62cc2e307f9f None None] Enqueued Resource ID: d9565223-6df9-45dd-b7a5-6140bb1e2fe2 with Priority: HIGHEST for action port [ 1334.023780] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9565223-6df9-45dd-b7a5-6140bb1e2fe2 with Priority: HIGHEST for action port [ 1334.024121] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9565223-6df9-45dd-b7a5-6140bb1e2fe2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.024584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9565223-6df9-45dd-b7a5-6140bb1e2fe2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.024584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9565223-6df9-45dd-b7a5-6140bb1e2fe2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.024584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9565223-6df9-45dd-b7a5-6140bb1e2fe2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.024738] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9565223-6df9-45dd-b7a5-6140bb1e2fe2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.529943] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9565223-6df9-45dd-b7a5-6140bb1e2fe2 [ 1334.530210] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.530349] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.530419] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.530652] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.530740] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.530832] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9565223-6df9-45dd-b7a5-6140bb1e2fe2 already deleted. [ 1334.530913] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9565223-6df9-45dd-b7a5-6140bb1e2fe2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.865613] env[69343]: INFO networking_nsxv3.common.synchronization [None req-4a259892-f50b-4974-b121-39652c9db34d None None] Enqueued Resource ID: 07a02fd9-bf41-472a-840a-802895b26a9e with Priority: HIGHEST for action port [ 1335.866410] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07a02fd9-bf41-472a-840a-802895b26a9e with Priority: HIGHEST for action port [ 1335.867344] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-07a02fd9-bf41-472a-840a-802895b26a9e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.867527] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07a02fd9-bf41-472a-840a-802895b26a9e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.867636] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07a02fd9-bf41-472a-840a-802895b26a9e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.868010] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07a02fd9-bf41-472a-840a-802895b26a9e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.868150] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07a02fd9-bf41-472a-840a-802895b26a9e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.371467] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07a02fd9-bf41-472a-840a-802895b26a9e [ 1336.371764] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.371881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.371881] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.372109] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.372202] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.372302] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07a02fd9-bf41-472a-840a-802895b26a9e already deleted. [ 1336.372384] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07a02fd9-bf41-472a-840a-802895b26a9e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.979087] env[69343]: INFO networking_nsxv3.common.synchronization [req-4c3f73c1-2373-48d5-b7d2-5ea7bdc6f8c3 req-29a11ed9-645f-4203-bac5-f78267ccd94d tempest-ServerRescueNegativeTestJSON-1152108859 tempest-ServerRescueNegativeTestJSON-1152108859-project-member] Enqueued Resource ID: 22665e99-617e-43fb-a9ad-d103306b45c7 with Priority: HIGHEST for action security_group_members [ 1338.979630] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22665e99-617e-43fb-a9ad-d103306b45c7 with Priority: HIGHEST for action security_group_members [ 1338.979934] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-22665e99-617e-43fb-a9ad-d103306b45c7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.980159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.980159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.980384] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.980539] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.980636] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.980702] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.980855] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.980938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.981043] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.251415] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.251415] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-281" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.251415] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-281" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.251415] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-281" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.251415] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.251415] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.251415] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.252285] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.252643] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.253061] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1339.253448] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1339.254855] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1339.254855] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1339.254855] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1339.254855] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1339.254855] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1339.278623] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1339.278623] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1339.278623] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1339.278623] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-281" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.278623] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-b9b18356-a6f9-4422-b407-b409b2cf2044 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.278928] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-b9b18356-a6f9-4422-b407-b409b2cf2044" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.278928] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-b9b18356-a6f9-4422-b407-b409b2cf2044" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.279154] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-b9b18356-a6f9-4422-b407-b409b2cf2044" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.279296] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9b18356-a6f9-4422-b407-b409b2cf2044',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.483725] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.483964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.483964] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.484255] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.484356] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.484551] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.484645] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.484709] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.484862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.484936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.485035] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22665e99-617e-43fb-a9ad-d103306b45c7 already deleted. [ 1339.485110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.782382] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.782668] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.782775] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.783107] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.783290] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.783578] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port b9b18356-a6f9-4422-b407-b409b2cf2044 not found, creating... [ 1339.783759] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.783921] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.784141] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.784423] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.784584] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.784875] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.785049] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.785204] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.785437] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.785580] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.785725] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: b9b18356-a6f9-4422-b407-b409b2cf2044 is going to be created. [ 1339.806030] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.806406] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.806594] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.806934] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.807201] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.807475] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-b9b18356-a6f9-4422-b407-b409b2cf2044" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.542950] env[69343]: INFO networking_nsxv3.common.synchronization [req-4c3f73c1-2373-48d5-b7d2-5ea7bdc6f8c3 req-10c506de-417b-45ca-8def-636362848cde service nova] Enqueued Resource ID: 22665e99-617e-43fb-a9ad-d103306b45c7 with Priority: HIGHEST for action security_group_rules [ 1340.542950] env[69343]: INFO networking_nsxv3.common.synchronization [req-4c3f73c1-2373-48d5-b7d2-5ea7bdc6f8c3 req-10c506de-417b-45ca-8def-636362848cde service nova] Enqueued Resource ID: 22665e99-617e-43fb-a9ad-d103306b45c7 with Priority: HIGHEST for action security_group_members [ 1340.542950] env[69343]: INFO networking_nsxv3.common.synchronization [req-4c3f73c1-2373-48d5-b7d2-5ea7bdc6f8c3 req-10c506de-417b-45ca-8def-636362848cde service nova] Enqueued Resource ID: b9b18356-a6f9-4422-b407-b409b2cf2044 with Priority: HIGHEST for action port [ 1340.543325] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22665e99-617e-43fb-a9ad-d103306b45c7 with Priority: HIGHEST for action security_group_rules [ 1340.543398] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22665e99-617e-43fb-a9ad-d103306b45c7 with Priority: HIGHEST for action security_group_members [ 1340.543488] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b18356-a6f9-4422-b407-b409b2cf2044 with Priority: HIGHEST for action port [ 1340.543754] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22665e99-617e-43fb-a9ad-d103306b45c7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.543878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.543947] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.544217] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.544310] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.545117] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-22665e99-617e-43fb-a9ad-d103306b45c7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.547862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.547862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.547862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.547862] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.547862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.547862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.547862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.547862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.547862] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.547862] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9b18356-a6f9-4422-b407-b409b2cf2044 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.547862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9b18356-a6f9-4422-b407-b409b2cf2044" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.547862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9b18356-a6f9-4422-b407-b409b2cf2044" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.547862] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9b18356-a6f9-4422-b407-b409b2cf2044" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.547862] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9b18356-a6f9-4422-b407-b409b2cf2044',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.049418] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.050594] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-22665e99-617e-43fb-a9ad-d103306b45c7 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.050837] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.050923] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9b18356-a6f9-4422-b407-b409b2cf2044 with status ACTIVE [ 1341.051108] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.051246] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.051328] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.051559] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.051831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.052046] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.052174] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.052261] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.052447] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.052538] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.052798] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.052917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.053012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.053197] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.053281] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.053645] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9b18356-a6f9-4422-b407-b409b2cf2044 is going to be updated. [ 1341.079036] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.079239] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.079239] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.079445] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.079583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.079742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9b18356-a6f9-4422-b407-b409b2cf2044" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.119904] env[69343]: INFO networking_nsxv3.common.synchronization [req-2fdffb63-9b30-47ce-96dc-63718e8392f3 req-076dd517-20ef-4d65-8f2b-bb905b95b085 tempest-ServerRescueNegativeTestJSON-1152108859 tempest-ServerRescueNegativeTestJSON-1152108859-project-member] Enqueued Resource ID: 22665e99-617e-43fb-a9ad-d103306b45c7 with Priority: HIGHEST for action security_group_members [ 1341.120523] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22665e99-617e-43fb-a9ad-d103306b45c7 with Priority: HIGHEST for action security_group_members [ 1341.120874] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-22665e99-617e-43fb-a9ad-d103306b45c7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.120955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.438849] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.439077] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-281" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.439216] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-281" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.439510] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-281" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.439784] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.439977] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.440259] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.440518] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.441116] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.441116] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1341.441116] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1341.441116] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1341.441307] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1341.441355] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1341.441446] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1341.441582] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1341.462692] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1341.462862] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1341.463018] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1341.463211] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-281" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.463544] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-8689c788-bf6c-434c-aee7-1f4eac9678c2 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.463718] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-8689c788-bf6c-434c-aee7-1f4eac9678c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.463846] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-8689c788-bf6c-434c-aee7-1f4eac9678c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.464253] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-8689c788-bf6c-434c-aee7-1f4eac9678c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.464414] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8689c788-bf6c-434c-aee7-1f4eac9678c2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.555934] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.967220] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.967426] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.967570] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.967780] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.967940] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.968113] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 8689c788-bf6c-434c-aee7-1f4eac9678c2 not found, creating... [ 1341.968380] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.968562] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.968691] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.968923] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.969078] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.969363] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.969523] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.969645] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.969857] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.969996] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.970158] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 8689c788-bf6c-434c-aee7-1f4eac9678c2 is going to be created. [ 1341.991128] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.991336] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.991469] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.991749] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.991989] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.992235] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-8689c788-bf6c-434c-aee7-1f4eac9678c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.058211] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.058525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.058525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.058703] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.058802] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.058905] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22665e99-617e-43fb-a9ad-d103306b45c7 is going to be created. [ 1342.095198] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.095525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.095525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.095605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.095772] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.107268] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22665e99-617e-43fb-a9ad-d103306b45c7 in Status: UNINITIALIZED for 2s [ 1342.755132] env[69343]: INFO networking_nsxv3.common.synchronization [req-2fdffb63-9b30-47ce-96dc-63718e8392f3 req-dde3a770-05a6-4457-8751-b9dcd9a1eeb3 service nova] Enqueued Resource ID: 22665e99-617e-43fb-a9ad-d103306b45c7 with Priority: HIGHEST for action security_group_rules [ 1342.755397] env[69343]: INFO networking_nsxv3.common.synchronization [req-2fdffb63-9b30-47ce-96dc-63718e8392f3 req-dde3a770-05a6-4457-8751-b9dcd9a1eeb3 service nova] Enqueued Resource ID: 22665e99-617e-43fb-a9ad-d103306b45c7 with Priority: HIGHEST for action security_group_members [ 1342.755446] env[69343]: INFO networking_nsxv3.common.synchronization [req-2fdffb63-9b30-47ce-96dc-63718e8392f3 req-dde3a770-05a6-4457-8751-b9dcd9a1eeb3 service nova] Enqueued Resource ID: 8689c788-bf6c-434c-aee7-1f4eac9678c2 with Priority: HIGHEST for action port [ 1342.755669] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22665e99-617e-43fb-a9ad-d103306b45c7 with Priority: HIGHEST for action security_group_rules [ 1342.755798] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22665e99-617e-43fb-a9ad-d103306b45c7 with Priority: HIGHEST for action security_group_members [ 1342.755897] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8689c788-bf6c-434c-aee7-1f4eac9678c2 with Priority: HIGHEST for action port [ 1342.756526] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22665e99-617e-43fb-a9ad-d103306b45c7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.756589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.756771] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-22665e99-617e-43fb-a9ad-d103306b45c7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.756889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.757039] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-8689c788-bf6c-434c-aee7-1f4eac9678c2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.757143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8689c788-bf6c-434c-aee7-1f4eac9678c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.757208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8689c788-bf6c-434c-aee7-1f4eac9678c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.757423] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8689c788-bf6c-434c-aee7-1f4eac9678c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.757506] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8689c788-bf6c-434c-aee7-1f4eac9678c2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.136117] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.136352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.136476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.136648] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.136770] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.259737] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8689c788-bf6c-434c-aee7-1f4eac9678c2 with status ACTIVE [ 1343.259979] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.260113] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.260191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.260411] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.260507] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.260699] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.260790] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.260858] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.261027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.261090] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.261272] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.261366] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.261426] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.261617] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.261649] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.261710] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8689c788-bf6c-434c-aee7-1f4eac9678c2 is going to be updated. [ 1343.287494] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.287643] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.287684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.287889] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.288037] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.288197] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8689c788-bf6c-434c-aee7-1f4eac9678c2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.639297] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.116621] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22665e99-617e-43fb-a9ad-d103306b45c7 in Status: SUCCESS [ 1344.117034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.117034] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.117199] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.117404] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.117524] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.117583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.117745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.117826] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.117913] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.118025] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.118907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.119083] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.119238] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.119343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.119399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.119536] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.119610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.119691] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.141698] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.621840] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-22665e99-617e-43fb-a9ad-d103306b45c7 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.622170] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.622262] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.643364] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1344.643617] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1345.125186] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.470221] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.470492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.470492] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.470718] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.483640] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1345.484565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.485284] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1345.523483] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.523700] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.523700] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.523887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.537311] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.538146] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1345.538229] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1345.538322] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1345.581336] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.581548] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.581624] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.581774] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.582981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.583177] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1345.628253] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.628480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.628480] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.628673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.628762] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.628865] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22665e99-617e-43fb-a9ad-d103306b45c7 is going to be updated. [ 1345.661834] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.662082] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.662082] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.662265] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.662408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.673958] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22665e99-617e-43fb-a9ad-d103306b45c7 in Status: IN_PROGRESS for 2s [ 1345.679259] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.679462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.679462] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.679746] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.679999] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.680308] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1345.787525] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.787752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.787752] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.787933] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.788274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.788584] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:39. [ 1345.788675] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'204e1fe8-d5fc-4557-a27f-fbf4bcfe3293', '245e50c5-d6d1-43b6-989e-be2a4b49ad04', 'e2fa593e-feb7-41a5-abd8-e3bf366056f7', '05ba88a3-ba5e-41f6-a0be-392b43ae9fcc', '052516cb-7b57-4fc8-95bb-1de193b1315b', '2fe57526-4a38-4213-b086-d05377278315', '8bec412e-0e1e-4a5b-8816-552633942519', '5c336180-c6d8-473b-8306-38646bd8e00e', '3973f86f-0821-4b7d-9e21-ccfe561c705b', '970edbb8-6a58-46c8-ad52-fe607c6c28e9', '2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b', 'b7614721-7a3e-40ba-83da-998503180bf3', 'f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9', 'c8943f91-6f84-437f-912a-5f193b3365a6', '0c195ad8-d052-4923-b668-42944e44042c', '1d14af5b-7c75-428d-a5d6-e177dfd3d4e5', '5edd58c8-45a0-43c5-b788-4aa742334ad2', '7b7e2ff9-f297-4beb-8beb-6260aaac3c39', '69f44a11-7085-48b3-ad36-634a77d99f4a', '7ceec863-0a7a-401b-a8e8-048823180971', 'd8742911-68ce-4e04-af8f-97f736173e2f', '53614dab-3dfd-44ee-8ebe-f06847c53bb0', 'a21b9c03-f940-48a9-8410-3b091dc5faa5', '4ff65ed7-3c36-4248-86bb-8bb20a53fde4', 'c88723a0-b73a-488b-a081-450e868cf48a', '6ce998c5-dc06-41cd-af9e-8a9554ca2092', '118b632b-56d4-49fc-a94f-fd72aafb1afd', '4f4a1283-038d-4b9a-8c1a-7e43a4c6645d', '67480949-2dd7-420c-b751-f7f48b752f53', 'a1f09c79-4735-45a5-8af5-ec47fcc9b65f', 'fdbb645d-14e7-4764-8083-5c521a4adb8c', '3858135f-36a9-49b7-8e06-7f64944b17c1', '1db02b01-820f-4081-802a-12188735ffe1', 'c490ab0a-5a62-4845-ab43-b72f0c00e5c1', '3d094c60-3a3c-417f-8a4b-5bc3132f56a7', 'ae6fe3b9-71f0-4911-a9b7-b9a4f89896c8', '06e6e2d6-f175-4be9-be9a-bdb1208e0e04', 'ac5de742-586a-4eea-8d29-9efb080dd556', 'f65fedc2-bd86-4b46-8ea8-95f7086801cf'} {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1345.788778] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1345.808871] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.809133] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.809133] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.809311] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.809400] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.809512] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1345.809587] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1345.809660] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1345.888884] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.889134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.889134] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.889324] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.890509] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.890792] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1345.890873] env[69343]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69343) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1345.890948] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1345.891027] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1345.891111] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/39 resources of Type:Security Group Rules [ 1345.891184] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGH for action security_group_rules [ 1345.891265] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 with Priority: HIGH for action security_group_rules [ 1345.891329] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGH for action security_group_rules [ 1345.891392] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGH for action security_group_rules [ 1345.891454] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 052516cb-7b57-4fc8-95bb-1de193b1315b with Priority: HIGH for action security_group_rules [ 1345.891515] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGH for action security_group_rules [ 1345.891577] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGH for action security_group_rules [ 1345.891637] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGH for action security_group_rules [ 1345.891699] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGH for action security_group_rules [ 1345.891761] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGH for action security_group_rules [ 1345.891821] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b with Priority: HIGH for action security_group_rules [ 1345.891882] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b7614721-7a3e-40ba-83da-998503180bf3 with Priority: HIGH for action security_group_rules [ 1345.891942] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 with Priority: HIGH for action security_group_rules [ 1345.892008] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGH for action security_group_rules [ 1345.892074] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c195ad8-d052-4923-b668-42944e44042c with Priority: HIGH for action security_group_rules [ 1345.892135] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 with Priority: HIGH for action security_group_rules [ 1345.892197] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 with Priority: HIGH for action security_group_rules [ 1345.892263] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGH for action security_group_rules [ 1345.892327] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69f44a11-7085-48b3-ad36-634a77d99f4a with Priority: HIGH for action security_group_rules [ 1345.892390] env[69343]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGH for action security_group_rules [ 1345.892484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.456260] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.456612] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-656" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.456662] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-656" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.456980] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-656" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.457349] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.457539] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.457690] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.457951] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.458174] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.458433] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1347.458570] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1347.458688] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1347.458802] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1347.458918] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1347.459038] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1347.459181] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1347.477608] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1347.477759] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1347.477890] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1347.478097] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-656" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.478415] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-05142183-51ba-4d8b-b2a3-46be8a85d1fd taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.478589] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-05142183-51ba-4d8b-b2a3-46be8a85d1fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.478710] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-05142183-51ba-4d8b-b2a3-46be8a85d1fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.478973] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-05142183-51ba-4d8b-b2a3-46be8a85d1fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.479131] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05142183-51ba-4d8b-b2a3-46be8a85d1fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.684323] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22665e99-617e-43fb-a9ad-d103306b45c7 in Status: SUCCESS [ 1347.684586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.684736] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.684953] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.685159] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.685274] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.685337] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.685496] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.685575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.685669] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.756761] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1347.757035] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=3 [ 1347.757035] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 with Priority: HIGH for action security_group_rules [ 1347.757145] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGH for action security_group_rules [ 1347.757244] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bec412e-0e1e-4a5b-8816-552633942519 with Priority: HIGH for action security_group_rules [ 1347.757354] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c195ad8-d052-4923-b668-42944e44042c with Priority: HIGH for action security_group_rules [ 1347.757451] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ceec863-0a7a-401b-a8e8-048823180971 with Priority: HIGH for action security_group_rules [ 1347.757542] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69f44a11-7085-48b3-ad36-634a77d99f4a with Priority: HIGH for action security_group_rules [ 1347.757633] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 with Priority: HIGH for action security_group_rules [ 1347.757719] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 with Priority: HIGH for action security_group_rules [ 1347.757809] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8943f91-6f84-437f-912a-5f193b3365a6 with Priority: HIGH for action security_group_rules [ 1347.757902] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 with Priority: HIGH for action security_group_rules [ 1347.757991] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 with Priority: HIGH for action security_group_rules [ 1347.758094] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7614721-7a3e-40ba-83da-998503180bf3 with Priority: HIGH for action security_group_rules [ 1347.758181] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b with Priority: HIGH for action security_group_rules [ 1347.758266] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 with Priority: HIGH for action security_group_rules [ 1347.758356] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b with Priority: HIGH for action security_group_rules [ 1347.758443] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe57526-4a38-4213-b086-d05377278315 with Priority: HIGH for action security_group_rules [ 1347.758553] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c336180-c6d8-473b-8306-38646bd8e00e with Priority: HIGH for action security_group_rules [ 1347.759013] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 052516cb-7b57-4fc8-95bb-1de193b1315b with Priority: HIGH for action security_group_rules [ 1347.759143] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 with Priority: HIGH for action security_group_rules [ 1347.759245] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc with Priority: HIGH for action security_group_rules [ 1347.759587] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.759716] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.759779] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.759984] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.760080] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('204e1fe8-d5fc-4557-a27f-fbf4bcfe3293',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.761023] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.761168] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.761233] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.761374] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.761438] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.762187] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bec412e-0e1e-4a5b-8816-552633942519 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.762350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.762350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.762501] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.762586] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bec412e-0e1e-4a5b-8816-552633942519',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.763233] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c195ad8-d052-4923-b668-42944e44042c taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.763367] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.763630] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.763630] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.763630] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c195ad8-d052-4923-b668-42944e44042c',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.764302] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ceec863-0a7a-401b-a8e8-048823180971 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.764407] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.764476] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.764635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.764695] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ceec863-0a7a-401b-a8e8-048823180971',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.765486] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69f44a11-7085-48b3-ad36-634a77d99f4a taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.765597] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.765673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.765795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.765865] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69f44a11-7085-48b3-ad36-634a77d99f4a',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.766557] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.766684] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.766766] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.767758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.767758] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b7e2ff9-f297-4beb-8beb-6260aaac3c39',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.767758] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5edd58c8-45a0-43c5-b788-4aa742334ad2 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.767758] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.767972] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.767972] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.768075] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5edd58c8-45a0-43c5-b788-4aa742334ad2',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.768761] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8943f91-6f84-437f-912a-5f193b3365a6 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.768884] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.768954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.769075] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.769145] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8943f91-6f84-437f-912a-5f193b3365a6',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.769808] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.769989] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.770064] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.770259] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.770305] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d14af5b-7c75-428d-a5d6-e177dfd3d4e5',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.770928] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.771132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.771215] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.771392] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.771438] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.772098] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7614721-7a3e-40ba-83da-998503180bf3 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.772212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.772263] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.772408] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.772460] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7614721-7a3e-40ba-83da-998503180bf3',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.773226] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.773352] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.773403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.773525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.773713] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.774373] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.774491] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.774554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.774686] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.774755] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('970edbb8-6a58-46c8-ad52-fe607c6c28e9',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.775481] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3973f86f-0821-4b7d-9e21-ccfe561c705b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.775590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.775658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.775795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.775864] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3973f86f-0821-4b7d-9e21-ccfe561c705b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.778119] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fe57526-4a38-4213-b086-d05377278315 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.778247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.778316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.778510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.778553] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fe57526-4a38-4213-b086-d05377278315',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.779225] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c336180-c6d8-473b-8306-38646bd8e00e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.779328] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.779471] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.779547] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.779620] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c336180-c6d8-473b-8306-38646bd8e00e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.780347] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-052516cb-7b57-4fc8-95bb-1de193b1315b taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.780460] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.780665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.780665] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.780769] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('052516cb-7b57-4fc8-95bb-1de193b1315b',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.781458] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-245e50c5-d6d1-43b6-989e-be2a4b49ad04 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.781565] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.781631] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.781778] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.781850] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('245e50c5-d6d1-43b6-989e-be2a4b49ad04',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.782838] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.782936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.783048] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.783166] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.783240] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05ba88a3-ba5e-41f6-a0be-392b43ae9fcc',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.982091] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.982091] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.982091] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.982621] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.982720] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.983191] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.983416] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.983605] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.983878] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.984082] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.984466] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.984706] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.984896] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.985185] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.985384] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.985586] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 05142183-51ba-4d8b-b2a3-46be8a85d1fd is going to be updated. [ 1348.009076] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.009330] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.009443] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.009751] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.009946] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.010212] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-05142183-51ba-4d8b-b2a3-46be8a85d1fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.188525] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.350937] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.351177] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.351177] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.351380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.352944] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.353075] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.361079] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.361233] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.361996] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.362092] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.372385] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.372575] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.377996] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.378188] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.379075] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.379189] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.379888] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.379984] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.380728] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.380823] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.381537] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.381626] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.382340] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.382438] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.383046] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1348.383496] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.383589] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.384189] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1348.384588] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.384680] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.390849] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1348.391295] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.391391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.392033] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1348.392442] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.392529] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.393135] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1348.393534] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.393630] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.394284] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1348.394649] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.394744] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.395342] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1348.395714] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.395809] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.396422] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1348.396799] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.396894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.397485] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1348.397932] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.398082] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fe57526-4a38-4213-b086-d05377278315 is going to be deleted. [ 1348.399527] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.399662] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.399769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.400032] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.418018] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.418178] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69f44a11-7085-48b3-ad36-634a77d99f4a is going to be deleted. [ 1348.419103] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.419316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.435677] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.435894] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 245e50c5-d6d1-43b6-989e-be2a4b49ad04 is going to be deleted. [ 1348.436772] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.436987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.461608] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.461856] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.467185] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.467342] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ceec863-0a7a-401b-a8e8-048823180971 is going to be deleted. [ 1348.468218] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.468434] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.469743] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.469864] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.490582] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.490743] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8943f91-6f84-437f-912a-5f193b3365a6 is going to be deleted. [ 1348.491972] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.492224] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.494623] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.494769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.516583] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.516823] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bec412e-0e1e-4a5b-8816-552633942519 is going to be deleted. [ 1348.517627] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.517846] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.665406] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.665619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.666256] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.666431] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.690851] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.694197] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.694353] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 is going to be deleted. [ 1348.695287] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.695508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.698260] env[69343]: INFO networking_nsxv3.common.synchronization [req-cfb6d6d4-011c-4c1c-90d4-13c8bab67e0a req-a172f48c-bd5f-42e6-83cf-c1f594e865c8 service nova] Enqueued Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGHEST for action security_group_rules [ 1348.698443] env[69343]: INFO networking_nsxv3.common.synchronization [req-cfb6d6d4-011c-4c1c-90d4-13c8bab67e0a req-a172f48c-bd5f-42e6-83cf-c1f594e865c8 service nova] Enqueued Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGHEST for action security_group_members [ 1348.698588] env[69343]: INFO networking_nsxv3.common.synchronization [req-cfb6d6d4-011c-4c1c-90d4-13c8bab67e0a req-a172f48c-bd5f-42e6-83cf-c1f594e865c8 service nova] Enqueued Resource ID: 05142183-51ba-4d8b-b2a3-46be8a85d1fd with Priority: HIGHEST for action port [ 1348.699412] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGHEST for action security_group_rules [ 1348.699581] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGHEST for action security_group_members [ 1348.699669] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05142183-51ba-4d8b-b2a3-46be8a85d1fd with Priority: HIGHEST for action port [ 1348.699957] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.700089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.700310] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2fa593e-feb7-41a5-abd8-e3bf366056f7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.700418] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.700483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.700675] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.700825] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.701678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.701757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.701923] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.702045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.702126] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.702990] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-05142183-51ba-4d8b-b2a3-46be8a85d1fd taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.703119] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05142183-51ba-4d8b-b2a3-46be8a85d1fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.703185] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05142183-51ba-4d8b-b2a3-46be8a85d1fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.703877] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05142183-51ba-4d8b-b2a3-46be8a85d1fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.703877] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05142183-51ba-4d8b-b2a3-46be8a85d1fd',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.747495] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.747675] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5edd58c8-45a0-43c5-b788-4aa742334ad2 is going to be deleted. [ 1348.748732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.748732] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.795151] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.795339] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 052516cb-7b57-4fc8-95bb-1de193b1315b is going to be deleted. [ 1348.796360] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.796590] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.855307] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.855523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.876754] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.876943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.877724] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.877833] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7614721-7a3e-40ba-83da-998503180bf3 is going to be deleted. [ 1348.878748] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.878963] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.929623] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.929823] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c336180-c6d8-473b-8306-38646bd8e00e is going to be deleted. [ 1348.930725] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.930951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.959787] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.960021] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.970581] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.970779] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c195ad8-d052-4923-b668-42944e44042c is going to be deleted. [ 1348.971784] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.972041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.017701] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.017909] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.030177] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.030356] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 204e1fe8-d5fc-4557-a27f-fbf4bcfe3293 is going to be deleted. [ 1349.031418] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.031692] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.064283] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.064540] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.100835] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.101034] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b7e2ff9-f297-4beb-8beb-6260aaac3c39 is going to be deleted. [ 1349.102131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.102474] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.146157] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.146399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.157627] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.157806] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.182448] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.182654] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d14af5b-7c75-428d-a5d6-e177dfd3d4e5 is going to be deleted. [ 1349.183750] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.184031] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.193150] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.193313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.193402] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.193593] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.193694] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.193796] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22665e99-617e-43fb-a9ad-d103306b45c7 is going to be updated. [ 1349.204754] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.204975] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.205172] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.206218] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05142183-51ba-4d8b-b2a3-46be8a85d1fd with status ACTIVE [ 1349.206446] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.206586] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.206666] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.206870] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.206987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.207202] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.207364] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.207364] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.207553] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.207630] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.207779] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.207882] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.207941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.208089] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.208172] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.208272] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05142183-51ba-4d8b-b2a3-46be8a85d1fd is going to be updated. [ 1349.244971] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.244971] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.269950] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.270208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.270208] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.270305] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.270429] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.270595] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05142183-51ba-4d8b-b2a3-46be8a85d1fd" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.285490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.285676] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b is going to be deleted. [ 1349.286678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.286914] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.349694] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.349907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.349907] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.350148] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.350325] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.354143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.354318] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9 is going to be deleted. [ 1349.355212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.355470] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.359584] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.359790] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.389869] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22665e99-617e-43fb-a9ad-d103306b45c7 in Status: IN_PROGRESS for 2s [ 1349.441219] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.441449] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05ba88a3-ba5e-41f6-a0be-392b43ae9fcc is going to be deleted. [ 1349.442456] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.442763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.493286] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.493755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.514250] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.514450] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 970edbb8-6a58-46c8-ad52-fe607c6c28e9 is going to be deleted. [ 1349.515506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.515753] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.521291] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.521472] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.573207] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.573430] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3973f86f-0821-4b7d-9e21-ccfe561c705b is going to be deleted. [ 1349.574370] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.574607] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.574727] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.574831] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fe57526-4a38-4213-b086-d05377278315" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.574990] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.575173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.575256] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.575380] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69f44a11-7085-48b3-ad36-634a77d99f4a" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.575972] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.576193] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.576320] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.576455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-245e50c5-d6d1-43b6-989e-be2a4b49ad04" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.576605] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.576760] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.576841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.576963] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ceec863-0a7a-401b-a8e8-048823180971" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.577117] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.577270] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.577345] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.577453] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8943f91-6f84-437f-912a-5f193b3365a6" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.577580] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.577719] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.577796] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.577905] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bec412e-0e1e-4a5b-8816-552633942519" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.578041] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.578185] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.578260] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.578376] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.578500] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.578671] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.578742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.578842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5edd58c8-45a0-43c5-b788-4aa742334ad2" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.578952] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.579113] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.579197] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.580106] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.580268] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.580354] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.580477] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-052516cb-7b57-4fc8-95bb-1de193b1315b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.580845] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.580999] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.581097] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.581212] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7614721-7a3e-40ba-83da-998503180bf3" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.581343] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.581490] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.581567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.581674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c336180-c6d8-473b-8306-38646bd8e00e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.581799] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.581938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.582027] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.582143] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c195ad8-d052-4923-b668-42944e44042c" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.582270] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.582409] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.582484] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.582598] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-204e1fe8-d5fc-4557-a27f-fbf4bcfe3293" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.582722] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.582860] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.582936] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.583059] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b7e2ff9-f297-4beb-8beb-6260aaac3c39" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.583188] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.583327] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.583403] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.583506] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d14af5b-7c75-428d-a5d6-e177dfd3d4e5" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.583631] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.583778] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.583828] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.583940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ffd2b9c-f50b-40dd-8ab4-47a3cc8af52b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.584080] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.584231] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.584313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.584491] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2ea1833-85b8-4c5d-8b4e-a888ae04c9b9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.587348] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.587494] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.587554] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.588014] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.588014] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.588014] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05ba88a3-ba5e-41f6-a0be-392b43ae9fcc" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.662517] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.662735] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.662787] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.662987] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.663093] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.663216] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-970edbb8-6a58-46c8-ad52-fe607c6c28e9" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.688877] env[69343]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1349.689430] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.689585] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.689658] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.689910] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.690045] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.690124] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3973f86f-0821-4b7d-9e21-ccfe561c705b" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.710780] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.081974] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2fa593e-feb7-41a5-abd8-e3bf366056f7 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.082165] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.212914] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.213132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.213186] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.213636] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.213636] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.213636] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 is going to be updated. [ 1350.242353] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.242544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.242544] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.242742] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.242887] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.252314] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 in Status: IN_PROGRESS for 2s [ 1351.399593] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22665e99-617e-43fb-a9ad-d103306b45c7 in Status: SUCCESS [ 1351.399966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.399966] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.400226] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.400426] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.400543] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.400609] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.400765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.400847] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.400932] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.401100] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-22665e99-617e-43fb-a9ad-d103306b45c7 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.401191] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.401252] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.401391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.401527] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.401616] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.401674] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.401805] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.401878] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.401955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.402055] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.904533] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22665e99-617e-43fb-a9ad-d103306b45c7: rpc.has_security_group_logging(os_id): False [ 1351.923563] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.923798] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.923858] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.924110] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.924240] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.924495] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.924635] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.924711] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.924875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.924953] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.925195] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.925301] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.925379] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.925552] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.925639] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.925846] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.925965] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.926051] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.926222] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.926350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.926456] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22665e99-617e-43fb-a9ad-d103306b45c7 is going to be created. [ 1351.994509] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.994763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.994763] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.994937] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.995163] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.006651] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22665e99-617e-43fb-a9ad-d103306b45c7 in Status: IN_PROGRESS for 2s [ 1352.262840] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 in Status: SUCCESS [ 1352.263156] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.263350] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.263676] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.263798] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.263917] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.263983] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.264177] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.264280] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.264359] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.264451] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.766932] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.269404] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2fa593e-feb7-41a5-abd8-e3bf366056f7: rpc.has_security_group_logging(os_id): False [ 1353.290132] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.290382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.290382] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.290757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.290757] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.290980] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.291130] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.291197] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.291436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.291542] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.291668] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 is going to be created. [ 1353.358907] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.359177] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.359294] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.359525] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.359816] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.374581] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 in Status: IN_PROGRESS for 2s [ 1353.700670] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1353.700928] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1354.019396] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22665e99-617e-43fb-a9ad-d103306b45c7 in Status: SUCCESS [ 1354.019792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.019840] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.020060] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.020165] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.522857] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-22665e99-617e-43fb-a9ad-d103306b45c7 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.523136] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.523190] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.523546] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.523791] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.523938] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.524047] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.524300] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.524424] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.524615] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.524754] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.027436] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-22665e99-617e-43fb-a9ad-d103306b45c7 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.027755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.027755] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.027954] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.028164] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.028332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.028941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.028941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.028941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.028941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.028941] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-22665e99-617e-43fb-a9ad-d103306b45c7 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.028941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.029290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.029290] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.029351] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.029432] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.029489] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.029632] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.029711] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.029792] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.029915] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.390701] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 in Status: SUCCESS [ 1355.391841] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.531927] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22665e99-617e-43fb-a9ad-d103306b45c7: rpc.has_security_group_logging(os_id): False [ 1355.552060] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.552318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.552318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.552489] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.552584] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.552868] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.552960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.553037] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.553192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.553271] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.553466] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.553567] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.553621] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.553745] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.553875] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.554069] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.554195] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.554318] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.554372] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.554450] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.554538] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22665e99-617e-43fb-a9ad-d103306b45c7 is going to be updated. [ 1355.616422] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.616734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.616734] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.616970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.617141] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.634016] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22665e99-617e-43fb-a9ad-d103306b45c7 in Status: IN_PROGRESS for 2s [ 1357.652266] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22665e99-617e-43fb-a9ad-d103306b45c7 in Status: SUCCESS [ 1357.652761] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.702304] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1358.702715] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1363.703892] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1363.703892] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1368.705440] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1368.705805] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1373.706335] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.706810] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1375.761462] env[69343]: INFO networking_nsxv3.common.synchronization [None req-6fd2e61e-32e4-4b4f-846c-743eb0123aa7 tempest-ServerRescueNegativeTestJSON-1152108859 tempest-ServerRescueNegativeTestJSON-1152108859-project-member] Enqueued Resource ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 with Priority: HIGHEST for action security_group_rules [ 1375.761956] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 with Priority: HIGHEST for action security_group_rules [ 1375.762320] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-402ea1cc-a065-4e8f-a0d3-5f81565d2885 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.762483] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.762581] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.762827] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.762934] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('402ea1cc-a065-4e8f-a0d3-5f81565d2885',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.829804] env[69343]: INFO networking_nsxv3.common.synchronization [None req-0158df82-052e-4852-9dba-a00a66daa30b tempest-ServerRescueNegativeTestJSON-1152108859 tempest-ServerRescueNegativeTestJSON-1152108859-project-member] Enqueued Resource ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 with Priority: HIGHEST for action security_group_rules [ 1375.830393] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 with Priority: HIGHEST for action security_group_rules [ 1375.830995] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-402ea1cc-a065-4e8f-a0d3-5f81565d2885 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.831131] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.283366] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.283366] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.283366] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.283641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.283641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.283641] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 already deleted. [ 1376.283737] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.283836] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.284012] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.284095] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('402ea1cc-a065-4e8f-a0d3-5f81565d2885',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.803974] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.804391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.804391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.804391] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.804519] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.804626] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 already deleted. [ 1376.804673] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.831132] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1380.831526] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.075282] env[69343]: INFO networking_nsxv3.common.synchronization [req-3568f3a9-fa23-4536-9c7b-de7363526b75 req-a0d4ac9b-6fac-43db-8b86-25c5d488ad20 tempest-ServerRescueNegativeTestJSON-1152108859 tempest-ServerRescueNegativeTestJSON-1152108859-project-member] Enqueued Resource ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 with Priority: HIGHEST for action security_group_members [ 1381.075947] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 with Priority: HIGHEST for action security_group_members [ 1381.076429] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-402ea1cc-a065-4e8f-a0d3-5f81565d2885 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.076429] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.076429] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.076662] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.076794] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.076897] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.076960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.077157] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.077264] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.077356] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('402ea1cc-a065-4e8f-a0d3-5f81565d2885',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.325388] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.325593] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "network-281" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.325709] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "network-281" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.325981] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "network-281" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.326250] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.326412] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.326591] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.326796] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.326947] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.327193] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1381.327330] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] NeedRegenerationException {{(pid=69343) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1381.327399] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] no value, waiting for create lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1381.327515] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] value creation lock acquired {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1381.327628] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] No value present for key: 'zone-id' {{(pid=69343) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1381.327759] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Calling creation function for not-yet-present value {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1381.327899] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1381.352546] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1381.352836] env[69343]: DEBUG dogpile.cache.region [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69343) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1381.352915] env[69343]: DEBUG dogpile.lock [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Released creation lock {{(pid=69343) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1381.353042] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "network-281" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.353383] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock port-3291f452-e36c-4d2b-bcd3-cd7d8b4d510e taken with stack trace [, , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.353562] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "port-3291f452-e36c-4d2b-bcd3-cd7d8b4d510e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.353688] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "port-3291f452-e36c-4d2b-bcd3-cd7d8b4d510e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.354038] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "port-3291f452-e36c-4d2b-bcd3-cd7d8b4d510e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.354186] env[69343]: DEBUG networking_nsxv3.api.rpc [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3291f452-e36c-4d2b-bcd3-cd7d8b4d510e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.580022] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.580234] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.580277] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.580509] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.580609] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.580840] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.580961] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.581044] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.581225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.581332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.581430] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 already deleted. [ 1381.581516] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.857137] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.857575] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.857575] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.857728] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.857875] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.858045] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Segment Port 3291f452-e36c-4d2b-bcd3-cd7d8b4d510e not found, creating... [ 1381.858315] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.858474] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.858600] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.858816] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.858955] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.859254] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.859411] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.859534] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.859742] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.859881] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.860039] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Resource: SegmentPort with ID: 3291f452-e36c-4d2b-bcd3-cd7d8b4d510e is going to be created. [ 1381.882324] env[69343]: DEBUG networking_nsxv3.common.locking [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.882542] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.882672] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.882955] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.883211] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.883518] env[69343]: DEBUG oslo_concurrency.lockutils [None req-5bb1b4ec-63fe-4293-ba8e-700e8f5502a1 None None] Releasing lock "port-3291f452-e36c-4d2b-bcd3-cd7d8b4d510e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.560107] env[69343]: INFO networking_nsxv3.common.synchronization [req-3568f3a9-fa23-4536-9c7b-de7363526b75 req-11011744-99fc-440b-aa0b-0b09b9f12127 service nova] Enqueued Resource ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 with Priority: HIGHEST for action security_group_rules [ 1382.560321] env[69343]: INFO networking_nsxv3.common.synchronization [req-3568f3a9-fa23-4536-9c7b-de7363526b75 req-11011744-99fc-440b-aa0b-0b09b9f12127 service nova] Enqueued Resource ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 with Priority: HIGHEST for action security_group_members [ 1382.560435] env[69343]: INFO networking_nsxv3.common.synchronization [req-3568f3a9-fa23-4536-9c7b-de7363526b75 req-11011744-99fc-440b-aa0b-0b09b9f12127 service nova] Enqueued Resource ID: 3291f452-e36c-4d2b-bcd3-cd7d8b4d510e with Priority: HIGHEST for action port [ 1382.560990] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 with Priority: HIGHEST for action security_group_rules [ 1382.561171] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 with Priority: HIGHEST for action security_group_members [ 1382.561287] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3291f452-e36c-4d2b-bcd3-cd7d8b4d510e with Priority: HIGHEST for action port [ 1382.561565] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock rules-402ea1cc-a065-4e8f-a0d3-5f81565d2885 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.561689] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.561769] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.562227] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.562350] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('402ea1cc-a065-4e8f-a0d3-5f81565d2885',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.563602] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-402ea1cc-a065-4e8f-a0d3-5f81565d2885 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.563810] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.563898] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.564090] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.564269] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.564375] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.564436] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.564600] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.565754] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.565754] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('402ea1cc-a065-4e8f-a0d3-5f81565d2885',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.566532] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock port-3291f452-e36c-4d2b-bcd3-cd7d8b4d510e taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.566676] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3291f452-e36c-4d2b-bcd3-cd7d8b4d510e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.566726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3291f452-e36c-4d2b-bcd3-cd7d8b4d510e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.567610] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3291f452-e36c-4d2b-bcd3-cd7d8b4d510e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.567610] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3291f452-e36c-4d2b-bcd3-cd7d8b4d510e',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.064971] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-402ea1cc-a065-4e8f-a0d3-5f81565d2885 taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.065413] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.068491] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('402ea1cc-a065-4e8f-a0d3-5f81565d2885',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.069414] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3291f452-e36c-4d2b-bcd3-cd7d8b4d510e with status ACTIVE [ 1383.069605] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.069729] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.069795] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.070020] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.070114] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.070296] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.070393] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.070456] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.070601] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.070682] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.070861] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.070955] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.071025] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.071173] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.071249] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.071330] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3291f452-e36c-4d2b-bcd3-cd7d8b4d510e is going to be updated. [ 1383.093640] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.093640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.093640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.093640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.093640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.093640] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3291f452-e36c-4d2b-bcd3-cd7d8b4d510e" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.574225] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('402ea1cc-a065-4e8f-a0d3-5f81565d2885',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.077166] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.077166] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.077166] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.077602] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.077602] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.077602] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 is going to be created. [ 1384.101710] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.101849] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.101950] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.102141] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.102302] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.112467] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 in Status: UNINITIALIZED for 2s [ 1386.127394] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 in Status: SUCCESS [ 1386.127660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.127791] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.127981] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.128194] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.128360] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.128437] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.128740] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.128740] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.128740] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.128888] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('402ea1cc-a065-4e8f-a0d3-5f81565d2885',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.632295] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('402ea1cc-a065-4e8f-a0d3-5f81565d2885',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.135177] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 402ea1cc-a065-4e8f-a0d3-5f81565d2885: rpc.has_security_group_logging(os_id): False [ 1387.156212] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.156421] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.156493] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.156750] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.156895] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.157132] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.157247] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.157316] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.157489] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.157577] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.157666] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 is going to be created. [ 1387.222308] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.222523] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.222652] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.222940] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.223242] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.236155] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 in Status: IN_PROGRESS for 2s [ 1387.562263] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1387.562482] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1389.248756] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 in Status: SUCCESS [ 1389.249077] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.563753] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.564134] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.565141] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.565497] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1399.440725] env[69343]: INFO networking_nsxv3.common.synchronization [req-c912566c-5563-4d2a-88d9-c4bc0c94a716 req-36f9b17a-8ae8-4fff-81c7-ec9646598dff tempest-AttachVolumeShelveTestJSON-1111703815 tempest-AttachVolumeShelveTestJSON-1111703815-project-member] Enqueued Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGHEST for action security_group_members [ 1399.441070] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 with Priority: HIGHEST for action security_group_members [ 1399.441196] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2fa593e-feb7-41a5-abd8-e3bf366056f7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.441801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.441801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.441801] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.442658] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.442781] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.442849] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.443056] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.443159] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.443298] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2fa593e-feb7-41a5-abd8-e3bf366056f7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.947832] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.947832] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.948304] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.948304] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.948433] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.948679] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.948941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.948941] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.949204] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.949291] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.949407] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 is going to be updated. [ 1399.978516] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.978726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.978726] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.978894] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.979070] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.988160] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 in Status: IN_PROGRESS for 2s [ 1402.000446] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 in Status: SUCCESS [ 1402.000446] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2fa593e-feb7-41a5-abd8-e3bf366056f7 deletion is rescheduled due to dependency. [ 1402.000446] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2fa593e-feb7-41a5-abd8-e3bf366056f7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.441959] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1404.442504] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1409.443574] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1409.443940] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1414.444957] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1414.445365] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1419.446748] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1419.446748] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1424.447923] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1424.448332] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1429.449019] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1429.449442] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1434.450868] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1434.451297] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1439.452483] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1439.452483] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1444.453601] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1444.453601] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1449.453999] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1449.454530] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1454.455635] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1454.455635] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1459.456845] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1459.457254] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1464.457959] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1464.458412] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1469.459570] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1469.459570] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1474.460735] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1474.461224] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1479.461526] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1479.461977] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1484.462504] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1484.462952] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1488.633706] env[69343]: INFO networking_nsxv3.common.synchronization [req-46bb008e-e8c7-4eae-a987-639d7f37f017 req-01517271-7e81-4e5f-bc51-3075ee31897f tempest-ServerRescueNegativeTestJSON-1152108859 tempest-ServerRescueNegativeTestJSON-1152108859-project-member] Enqueued Resource ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 with Priority: HIGHEST for action security_group_members [ 1488.634398] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 with Priority: HIGHEST for action security_group_members [ 1488.634774] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-402ea1cc-a065-4e8f-a0d3-5f81565d2885 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.634951] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.635192] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.635449] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.635682] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.635851] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.636102] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.636225] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.636369] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.636529] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('402ea1cc-a065-4e8f-a0d3-5f81565d2885',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1489.141376] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.141619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.141619] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.141842] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.141943] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.142216] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.142333] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.142399] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.142560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.142641] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.142746] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 is going to be updated. [ 1489.183328] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.183574] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.183574] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.183765] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.183912] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.193374] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 in Status: IN_PROGRESS for 2s [ 1491.204772] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 in Status: SUCCESS [ 1491.205184] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 402ea1cc-a065-4e8f-a0d3-5f81565d2885 deletion is rescheduled due to dependency. [ 1491.205184] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-402ea1cc-a065-4e8f-a0d3-5f81565d2885" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.635056] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1493.635460] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1498.636379] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1498.636716] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1499.741440] env[69343]: INFO networking_nsxv3.common.synchronization [req-af9e90dd-5d3a-4159-8810-e475fc131fe4 req-ebc1bc5d-2f05-4511-9b65-d14922dadb90 tempest-ServerRescueNegativeTestJSON-1152108859 tempest-ServerRescueNegativeTestJSON-1152108859-project-member] Enqueued Resource ID: 22665e99-617e-43fb-a9ad-d103306b45c7 with Priority: HIGHEST for action security_group_members [ 1499.741440] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22665e99-617e-43fb-a9ad-d103306b45c7 with Priority: HIGHEST for action security_group_members [ 1499.741440] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-22665e99-617e-43fb-a9ad-d103306b45c7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.741440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.741440] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.742132] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.742420] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.742653] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.742834] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.743112] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.743367] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.743592] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1500.248410] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1500.750758] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.253270] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.253510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.253510] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.253775] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.254313] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.254313] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22665e99-617e-43fb-a9ad-d103306b45c7 is going to be updated. [ 1501.284499] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.284678] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.284741] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.284898] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.285057] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.293532] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22665e99-617e-43fb-a9ad-d103306b45c7 in Status: IN_PROGRESS for 2s [ 1503.306116] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22665e99-617e-43fb-a9ad-d103306b45c7 in Status: SUCCESS [ 1503.306508] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.741451] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1504.741796] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1506.382889] env[69343]: INFO networking_nsxv3.common.synchronization [req-d13c2820-b5a1-4075-b482-b9107cadeaa9 req-4c4e0a19-42be-4363-804c-2f34dcddde4e tempest-ServerRescueNegativeTestJSON-1152108859 tempest-ServerRescueNegativeTestJSON-1152108859-project-member] Enqueued Resource ID: 22665e99-617e-43fb-a9ad-d103306b45c7 with Priority: HIGHEST for action security_group_members [ 1506.383298] env[69343]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22665e99-617e-43fb-a9ad-d103306b45c7 with Priority: HIGHEST for action security_group_members [ 1506.383626] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock member-22665e99-617e-43fb-a9ad-d103306b45c7 taken with stack trace [, , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.383698] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.383782] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.383994] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.384138] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.384227] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.384287] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.384444] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.384528] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.384777] env[69343]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22665e99-617e-43fb-a9ad-d103306b45c7',) {} {{(pid=69343) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.886660] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.886660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.886660] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.886970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.886970] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.887149] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.887272] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.887332] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.887455] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.887532] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.887619] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22665e99-617e-43fb-a9ad-d103306b45c7 is going to be updated. [ 1506.915717] env[69343]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69343) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.915960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.915960] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.916155] env[69343]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.916275] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.923891] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22665e99-617e-43fb-a9ad-d103306b45c7 in Status: IN_PROGRESS for 2s [ 1508.935154] env[69343]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22665e99-617e-43fb-a9ad-d103306b45c7 in Status: SUCCESS [ 1508.935560] env[69343]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22665e99-617e-43fb-a9ad-d103306b45c7 deletion is rescheduled due to dependency. [ 1508.935560] env[69343]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22665e99-617e-43fb-a9ad-d103306b45c7" {{(pid=69343) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.384824] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1511.384824] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1516.386152] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1516.386615] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1521.386890] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1521.387292] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1526.198956] env[69343]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1526.199401] env[69343]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-e96e1088-9ffc-4456-8054-4522c6a66156 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1526.388330] env[69343]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1526.388567] env[69343]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0